-- Logs begin at Tue 2022-05-03 09:18:26 UTC, end at Tue 2022-05-03 10:02:25 UTC. -- May 03 09:46:08.033357 dv-cinder-796806-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 03 09:46:08.040825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 03 09:46:08.045825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 3 09:46:08 2022] *** May 03 09:46:08.045825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 03 09:46:08.045825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 03 09:46:08.045825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: nodename: dv-cinder-796806-3-iscsi May 03 09:46:08.045825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: machine: x86_64 May 03 09:46:08.045825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: clock source: unix May 03 09:46:08.045825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: pcre jit disabled May 03 09:46:08.045825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: detected number of CPU cores: 4 May 03 09:46:08.045825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: current working directory: / May 03 09:46:08.045825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: detected binary path: /usr/bin/uwsgi-core May 03 09:46:08.045825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: your processes number limit is 47680 May 03 09:46:08.045825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: your memory page size is 4096 bytes May 03 09:46:08.045825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: detected max file descriptor number: 2048 May 03 09:46:08.045825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: lock engine: pthread robust mutexes May 03 09:46:08.045825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: thunder lock: enabled May 03 09:46:08.045825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 03 09:46:08.045825 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 03 09:46:08.088545 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: Python main interpreter initialized at 0x5637d7a4f9c0 May 03 09:46:08.088545 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: python threads support enabled May 03 09:46:08.088545 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: your server socket listen backlog is limited to 100 connections May 03 09:46:08.088545 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: your mercy for graceful operations on workers is 90 seconds May 03 09:46:08.088911 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: mapped 403077 bytes (393 KB) for 2 cores May 03 09:46:08.089016 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: *** Operational MODE: preforking *** May 03 09:46:08.089297 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: *** uWSGI is running in multiple interpreter mode *** May 03 09:46:08.089297 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: spawned uWSGI master process (pid: 79776) May 03 09:46:08.089545 dv-cinder-796806-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 03 09:46:08.090355 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: spawned uWSGI worker 1 (pid: 79789, cores: 1) May 03 09:46:08.090522 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: spawned uWSGI worker 2 (pid: 79790, cores: 1) May 03 09:46:08.090662 dv-cinder-796806-3-iscsi devstack@keystone.service[79776]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 03 09:46:13.743566 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 09:46:13.743566 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: from cryptography.utils import int_from_bytes May 03 09:46:13.744386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 09:46:13.744386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: from cryptography.utils import int_from_bytes May 03 09:46:13.749427 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 09:46:13.749427 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: from cryptography.utils import int_from_bytes May 03 09:46:13.749980 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 09:46:13.749980 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: from cryptography.utils import int_from_bytes May 03 09:46:13.793847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 09:46:13.794012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 09:46:13.794248 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] command line args: [] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 09:46:13.794501 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 09:46:13.794690 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ================================================================================ {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 09:46:13.794925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] admin_token = **** {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.795127 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] config_dir = [] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.795354 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.795543 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] config_source = [] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.795686 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] debug = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.795867 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.798210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.798210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.798210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.798210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.798210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] list_limit = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.798210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] log_config_append = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.798210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.798210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] log_dir = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.798210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] log_file = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.798685 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.798685 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.798685 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.798685 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.798905 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 09:46:13.798967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.799026 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 09:46:13.799091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.799151 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] command line args: [] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 09:46:13.799213 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.799277 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 09:46:13.799683 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.799888 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ================================================================================ {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 09:46:13.800090 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.800276 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] admin_token = **** {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.800475 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.800660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] config_dir = [] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.800853 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.801039 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.801039 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] config_source = [] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.801411 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.801604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] debug = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.801825 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.801990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.802250 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.802410 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.802597 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.802797 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.802797 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.803153 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.803354 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.803540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] publish_errors = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.803724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] list_limit = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.803724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] log_config_append = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.804095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.804281 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.804446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.804612 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] log_dir = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.804742 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.804902 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] log_file = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.805051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.805208 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.805337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.805472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.805605 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] standard_threads = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.805742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.805947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.806078 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.806309 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.806450 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.806579 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.806706 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.806854 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] use_journal = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.806986 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.807119 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] use_json = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.807119 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] use_stderr = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.807397 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.807533 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] use_syslog = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.807665 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.807798 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.807923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.808123 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.808261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.808387 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.808519 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.808657 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.808804 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.808938 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.809075 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.809201 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.809332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.809465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.809465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.809702 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.809889 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.809889 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.809889 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.810288 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] publish_errors = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.810288 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.810544 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.810669 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.810800 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.810933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.811059 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.811198 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.811331 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.811456 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.811586 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.811712 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] standard_threads = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.811847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.811975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.812106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.812243 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.812368 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.812498 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.812498 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] use_journal = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.812815 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.812947 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] use_json = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.813079 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.813205 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] use_stderr = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.813205 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] use_syslog = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.813447 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.813579 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 09:46:13.813704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.813903 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.814037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.814175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.814312 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.814439 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.814570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.814697 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.814821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.814947 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.815084 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.815211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.815338 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.815338 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.815581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.815581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.815833 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.815959 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.816091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.816091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.816341 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.816472 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.816606 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.816732 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.816856 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.817016 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.817146 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.817273 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.817408 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.817534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.817669 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.817831 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.817964 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.818100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.818235 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.818363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.818488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.818614 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.818754 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.818880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.819081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.819210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.819337 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.819472 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.819598 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.819723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.819865 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.819991 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.820121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.820247 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.820372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.820506 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.820638 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.820764 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.820895 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.821020 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.821145 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.821291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.821419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.821544 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.821675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.821911 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.822059 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.822198 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.822326 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.822453 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.822579 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.822704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.822830 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.822963 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.824204 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.824374 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.824566 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.824754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.824948 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.825172 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.825336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.825522 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.825708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.825898 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.826084 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.826312 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.826515 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.826739 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.826952 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.827114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.827308 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.827531 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.827702 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.827890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.828111 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.828274 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.828461 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.828808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.829020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.829180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.829340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.829482 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.829643 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.829781 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.829983 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.830116 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.830252 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.830380 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.830506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.830664 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.830796 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.830933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.831061 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.831188 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.831188 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.831447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.831582 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.831717 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.831846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.832003 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.832135 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.832263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.832398 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.832526 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.832652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.832778 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.832905 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.833031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.833177 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.833311 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.833438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.833564 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.833699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.833699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.833988 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.834130 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.834259 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.834386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.834512 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.834669 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.834828 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.835035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.835177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.835304 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.835431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.835557 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.835691 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.835819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.835945 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.836073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.836199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.836332 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.836468 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.836596 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.836722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.836858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.836984 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.837111 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.837246 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.837448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.837596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.837596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.837875 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.838006 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.838146 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.838283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.838426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.838554 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.838695 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] auth.external = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.838834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.838964 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.839096 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.839233 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.839363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.839489 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.839615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.839742 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] auth.password = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.839868 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.840003 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] auth.token = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.840137 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.840265 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.840391 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.840528 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.840655 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.840790 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.840920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.841046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.841179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.841307 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.841433 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.841567 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.841695 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.841874 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.842007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.842134 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] credential.caching = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.842275 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.842441 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.842579 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.842716 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.842845 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.842978 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.843106 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.843233 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.843361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.843499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.843633 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.843767 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.843895 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.844022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.844149 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.844295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.844426 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.844559 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.844687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.844897 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.845050 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] auth.external = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.845182 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.845309 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.845436 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.845564 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.845692 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.845850 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.845985 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.846122 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] auth.password = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.846251 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.846380 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] auth.token = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.846507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] federation.caching = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.846646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.846787 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.846915 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.847042 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.847168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.847304 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.847441 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.847577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.847705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.847832 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.847976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.848104 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.848239 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.848368 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.848496 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] credential.caching = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.848632 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.848761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.848888 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.848888 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.849139 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.849266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.849266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] identity.caching = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.849506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.849644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.849780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.849941 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.849941 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.850182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.850309 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.850443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.850652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.850784 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.850912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.851151 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.851311 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.851441 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.851581 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.851724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.851853 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.851980 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.852113 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.852241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.852376 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.852505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.852632 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.852759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.852893 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.853021 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.853157 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.853285 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] federation.caching = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.853422 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.853550 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.853717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.853989 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.854134 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.854270 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.854405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.854533 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.854668 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.854795 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.854939 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.855069 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.855197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.855330 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.855470 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.855470 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.855721 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.855848 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.855976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.856105 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.856232 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.856367 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.856495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.856622 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.856749 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] identity.caching = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.856875 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.857003 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.857148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.857277 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.857404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.857531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.857658 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.857785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.857945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.858074 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.858202 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.858329 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.858455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.858588 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.858727 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.858863 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.859008 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.859137 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.859265 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.859391 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.859526 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.859662 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.859789 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.859921 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.860048 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.860176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.860312 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.860440 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.860567 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.860694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.860831 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.860959 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.861095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.861224 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.861352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.861478 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.861605 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.861732 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.861959 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.862097 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.862226 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.862353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.862481 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.862619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.862755 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.862883 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.863010 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.863137 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.863264 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.863391 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.863527 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.863656 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.863783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.863910 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.864037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.864165 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.864304 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.864449 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.864578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.864705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.864832 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.864959 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.865094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.865222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.865348 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.865476 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.865603 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.865729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.865923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.866053 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.866192 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.866320 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.866448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.866574 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.866710 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.866838 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.866965 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.867093 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.867219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.867219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.867468 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.867598 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.867598 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.867837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.867975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.868103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.868241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.868241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.868483 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.868675 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.868812 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.869063 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.869204 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.869333 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.869460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.869589 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.869719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.869911 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.870057 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.870185 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.870313 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.870440 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.870568 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.870705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.870834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.870961 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.871088 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.871216 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.871343 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.871480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.871608 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.871747 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.871875 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.872002 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.872130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.872266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.872394 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.872521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] resource.caching = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.872648 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.872776 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.872904 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.873039 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.873168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.873296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.873423 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.873561 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.873688 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.873845 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.873979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.874107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.874234 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.874362 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.874489 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.874624 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.874753 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.874880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.875007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.875134 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] role.caching = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.875261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.875407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] role.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.875537 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.875666 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.875793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.875921 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.876092 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.876299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.876432 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.876560 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.876688 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.876815 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.876944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.877080 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.877220 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.877348 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.877476 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.877603 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.877730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.877922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.878054 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.878182 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.878308 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.878435 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.878562 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.878707 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.878837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.878837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.879088 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.879217 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.879344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.879480 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.879609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.879736 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.879863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.879990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.880118 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.880257 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.880386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.880513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] resource.caching = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.880640 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.880778 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.880913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.881042 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.881172 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.881299 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.881425 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.881552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.881687 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.881840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.881974 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.882102 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.882229 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.882356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.882491 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.883029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.883190 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.883322 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.883450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.883577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] role.caching = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.883713 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.883842 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] role.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.883969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.884096 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.884242 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.884378 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.884514 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.884643 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.884781 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.884909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.885036 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] token.caching = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.885164 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.885306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.885436 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.885564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.885564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.885564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.885953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.886093 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.886220 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.886348 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.886474 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.886611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.886738 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.886874 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.887002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.887129 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.887256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.887383 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.887512 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.887647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.887775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.887903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.887903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.888143 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.888279 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.888415 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.888544 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.888681 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.888810 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.888937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.889064 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.889199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.889327 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.connection = **** {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.889465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.889603 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.889733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.889885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.890015 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.890163 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.890294 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.890421 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.890550 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.890677 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.890805 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.890940 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.891069 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.891196 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.891323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.891450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.891578 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.891714 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.891853 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.891980 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.892107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.892234 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.892362 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.892497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.892626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.892754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.892880 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.893007 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.893134 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] token.caching = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.893269 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.893399 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.893882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.894029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.894158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.894285 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.894466 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.894466 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 09:46:13.894710 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.894710 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.894710 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.894710 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.894710 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.894710 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.894710 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.894710 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.894710 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.895765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.895765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.895765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.895765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.895765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.895765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.connection = **** {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.895765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.895765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.895765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.896836 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.896836 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.896836 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.896836 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.896836 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.896836 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.896836 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.896836 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.896836 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.898005 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.898005 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.898005 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.898005 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.898005 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.898005 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 09:46:13.898005 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 09:46:13.908400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:13.908635 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:13.908858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:13.912650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:13.912886 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:13.913112 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:13.917639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:13.922320 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:13.946295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:13.946521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:13.950396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:13.950632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:13.999662 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.005183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.051244 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.051448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.053313 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.053641 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.116685 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.116869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.117127 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.117267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.117378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.117556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.117762 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.117973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.118207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.118527 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.118905 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.119223 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.141906 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.142057 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.142163 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.142342 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.142565 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.142722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.142812 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.142971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.143111 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.143198 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.143491 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.143800 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.144109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.144430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.154570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.155190 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.169304 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.169623 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.169809 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.169915 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.169993 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.170211 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.170336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.170439 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.170623 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.170828 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.171142 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.171445 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.171751 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.172055 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 09:46:14.187845 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.188067 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 09:46:14.188387 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.188513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.188618 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 09:46:14.188837 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.188962 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 09:46:14.189045 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.189333 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.189568 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.189708 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.189955 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 09:46:14.190313 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.190664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.191008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.191353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.201036 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.201314 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.201577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.201886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.202935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.203306 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.203674 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.204045 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.209966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.212335 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.213339 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.213616 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.213924 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.214310 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.214592 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.214851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.215104 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.215377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.215648 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.215918 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.216182 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.216778 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.217164 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.217567 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.218030 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.218409 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.218763 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.219123 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.219491 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.219887 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.220255 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.220616 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.242610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.244309 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.244589 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.247473 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.249199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.249577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.253882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.253882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.253882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.255149 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.255563 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.255952 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.258005 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.258292 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.262979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.263263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.263542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.263821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.264093 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.264366 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.264508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.264594 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.264876 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.265002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.269640 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.270045 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.270425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.270803 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.271173 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.271541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.271904 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.272266 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.286208 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.286208 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.288568 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.291473 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.291721 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.292186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.292484 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.296310 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.297494 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.299920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.300187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.301117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.304899 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.305108 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.305277 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.305422 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.305728 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.306045 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.306320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.308912 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.312643 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.312937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.313221 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.313498 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.313716 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.314048 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.325660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.326062 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.326306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.326587 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.332987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.333358 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.333601 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.333912 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.334469 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.336179 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.336464 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.339680 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.339963 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.340244 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.340495 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.340811 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.341895 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.343611 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.343857 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.346942 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.347174 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.347494 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.347779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.348025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.354371 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.354626 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.354935 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.355188 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.355492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.355737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.356045 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.361386 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.361636 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.361953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.362177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.362492 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.362740 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.363047 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.374409 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.377669 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.380956 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.381163 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.382947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.384604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.384809 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.385157 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.385157 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.387921 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.389493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.391131 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.391383 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.391691 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.392569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.394225 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.397434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.397699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.398031 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.398278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.399077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.400687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.404055 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.404317 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.404619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.404893 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.407627 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.407924 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.408181 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.414075 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.414374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.414651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.416161 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.416411 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.416721 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.417011 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.417296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.417567 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.417832 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.418127 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.418402 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.418616 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.418926 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.419185 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.419443 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.419716 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.422744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 09:46:14.423036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.423355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.423623 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.423888 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.424158 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.424425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.424692 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.424972 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.425247 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.425508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.425763 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.426057 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.426322 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 09:46:14.459071 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637d7a4f9c0 pid: 79790 (default app) May 03 09:46:14.462538 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92744370-b9f8-473e-8a18-f35a0fe000d3 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:14.462797 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92744370-b9f8-473e-8a18-f35a0fe000d3 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:14.463102 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92744370-b9f8-473e-8a18-f35a0fe000d3 None None] PATH_INFO: `/v3` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:14.464990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637d7a4f9c0 pid: 79789 (default app) May 03 09:46:14.467247 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 791 bytes} [Tue May 3 09:46:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:22.460773 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de22e4b-cad9-4acc-8d15-7fbf89fe54a5 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:22.461351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de22e4b-cad9-4acc-8d15-7fbf89fe54a5 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:22.461351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de22e4b-cad9-4acc-8d15-7fbf89fe54a5 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:22.465870 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 1/2] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:22.471427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a89819-e96d-4d5a-bd88-380cbb9a297b None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:22.471865 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a89819-e96d-4d5a-bd88-380cbb9a297b None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:22.471943 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a89819-e96d-4d5a-bd88-380cbb9a297b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:22.502816 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG oslo_db.sqlalchemy.engines [None req-95a89819-e96d-4d5a-bd88-380cbb9a297b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 09:46:22.682689 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG passlib.handlers.bcrypt [None req-95a89819-e96d-4d5a-bd88-380cbb9a297b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79790) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 03 09:46:22.683019 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG passlib.handlers.bcrypt [None req-95a89819-e96d-4d5a-bd88-380cbb9a297b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79790) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 03 09:46:22.739588 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-95a89819-e96d-4d5a-bd88-380cbb9a297b None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:22.741175 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-95a89819-e96d-4d5a-bd88-380cbb9a297b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:22.866492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 2/3] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 03 09:46:22.902877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de22e4b-cad9-4acc-8d15-7fbf89fe54a5 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:22.935908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG oslo_db.sqlalchemy.engines [None req-6de22e4b-cad9-4acc-8d15-7fbf89fe54a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79789) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 09:46:23.060128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de22e4b-cad9-4acc-8d15-7fbf89fe54a5 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:23.064803 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a8dc1-cd4e-4df0-adca-f031dffb80b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4434afe425d5493fb9f74ff63598d4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:23.065470 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a8dc1-cd4e-4df0-adca-f031dffb80b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:23.065746 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a8dc1-cd4e-4df0-adca-f031dffb80b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:23.066042 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a8dc1-cd4e-4df0-adca-f031dffb80b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:23.074274 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a8dc1-cd4e-4df0-adca-f031dffb80b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:23.124864 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: WARNING keystone.common.rbac_enforcer.enforcer [None req-831a8dc1-cd4e-4df0-adca-f031dffb80b8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 03 09:46:23.125201 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a8dc1-cd4e-4df0-adca-f031dffb80b8 admin admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:23.135266 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 2/4] 10.222.0.55 () {58 vars in 1324 bytes} [Tue May 3 09:46:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:46:23.141407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a89819-e96d-4d5a-bd88-380cbb9a297b None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:23.155791 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a89819-e96d-4d5a-bd88-380cbb9a297b None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:23.161012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967d244-54af-48e2-bc84-c09740bf96c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4434afe425d5493fb9f74ff63598d4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:23.162175 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967d244-54af-48e2-bc84-c09740bf96c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:23.162459 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967d244-54af-48e2-bc84-c09740bf96c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:23.162730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967d244-54af-48e2-bc84-c09740bf96c4 admin admin] PATH_INFO: `/v3/projects/4434afe425d5493fb9f74ff63598d4e4` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:23.164237 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967d244-54af-48e2-bc84-c09740bf96c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=4434afe425d5493fb9f74ff63598d4e4)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:23.214066 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1967d244-54af-48e2-bc84-c09740bf96c4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 03 09:46:23.214321 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967d244-54af-48e2-bc84-c09740bf96c4 admin admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:23.219135 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 3/5] 10.222.0.55 () {56 vars in 1207 bytes} [Tue May 3 09:46:23 2022] GET /identity/v3/projects/4434afe425d5493fb9f74ff63598d4e4 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:25.424219 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b24b80-ae70-4407-a2fd-245af71731c3 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:25.424785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b24b80-ae70-4407-a2fd-245af71731c3 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:25.424785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b24b80-ae70-4407-a2fd-245af71731c3 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:25.429024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 3/6] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:25.434343 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5fc8c-fde9-4930-96fa-07e074a63095 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:25.434771 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5fc8c-fde9-4930-96fa-07e074a63095 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:25.434869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5fc8c-fde9-4930-96fa-07e074a63095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:25.455156 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-c5d5fc8c-fde9-4930-96fa-07e074a63095 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:25.456645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-c5d5fc8c-fde9-4930-96fa-07e074a63095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:25.465365 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 4/7] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 03 09:46:25.487399 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b24b80-ae70-4407-a2fd-245af71731c3 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:25.500667 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b24b80-ae70-4407-a2fd-245af71731c3 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:25.505891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1b9dd-855f-4536-a1bc-bd9db72d5f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4434afe425d5493fb9f74ff63598d4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:25.506530 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1b9dd-855f-4536-a1bc-bd9db72d5f09 admin admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:25.506812 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1b9dd-855f-4536-a1bc-bd9db72d5f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:25.507078 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1b9dd-855f-4536-a1bc-bd9db72d5f09 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:25.515711 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1b9dd-855f-4536-a1bc-bd9db72d5f09 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:25.517505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1b9dd-855f-4536-a1bc-bd9db72d5f09 admin admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:25.526527 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 4/8] 10.222.0.55 () {58 vars in 1324 bytes} [Tue May 3 09:46:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:46:25.532114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5fc8c-fde9-4930-96fa-07e074a63095 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:25.541332 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5fc8c-fde9-4930-96fa-07e074a63095 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:25.546959 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c165d-a10f-4e38-9efa-04cf920adb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4434afe425d5493fb9f74ff63598d4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:25.547830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c165d-a10f-4e38-9efa-04cf920adb43 admin admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:25.548108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c165d-a10f-4e38-9efa-04cf920adb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:25.548373 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c165d-a10f-4e38-9efa-04cf920adb43 admin admin] PATH_INFO: `/v3/users/3409da654b054b979d2c52a756bb7ee6` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:25.549984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c165d-a10f-4e38-9efa-04cf920adb43 admin admin] RBAC: Authorizing `identity:get_user(user_id=3409da654b054b979d2c52a756bb7ee6)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:25.551813 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c165d-a10f-4e38-9efa-04cf920adb43 admin admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:25.553364 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 5/9] 10.222.0.55 () {56 vars in 1198 bytes} [Tue May 3 09:46:25 2022] GET /identity/v3/users/3409da654b054b979d2c52a756bb7ee6 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:27.838772 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07019351-2d30-4546-805a-9648c5c4c5bf None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:27.839311 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07019351-2d30-4546-805a-9648c5c4c5bf None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:27.839311 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07019351-2d30-4546-805a-9648c5c4c5bf None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:27.840676 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 5/10] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:27.845910 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96115a-5277-4afe-b28f-55f4114f9017 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:27.846316 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96115a-5277-4afe-b28f-55f4114f9017 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:27.846493 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96115a-5277-4afe-b28f-55f4114f9017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:27.884369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c99a40-ed51-48e5-a4fa-e212f58b0cb9 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:27.885200 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c99a40-ed51-48e5-a4fa-e212f58b0cb9 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:27.885485 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c99a40-ed51-48e5-a4fa-e212f58b0cb9 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:27.886957 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 6/11] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:27.892783 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cd218-ab7b-419b-86de-ebf9085f4891 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:27.893084 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cd218-ab7b-419b-86de-ebf9085f4891 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:27.893351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cd218-ab7b-419b-86de-ebf9085f4891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:27.941656 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG passlib.handlers.bcrypt [None req-598cd218-ab7b-419b-86de-ebf9085f4891 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79789) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 03 09:46:27.942171 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG passlib.handlers.bcrypt [None req-598cd218-ab7b-419b-86de-ebf9085f4891 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79789) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 03 09:46:27.976474 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-5d96115a-5277-4afe-b28f-55f4114f9017 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:27.978107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-5d96115a-5277-4afe-b28f-55f4114f9017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:27.990457 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-598cd218-ab7b-419b-86de-ebf9085f4891 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:27.992036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-598cd218-ab7b-419b-86de-ebf9085f4891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:28.061593 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 6/12] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:28.084943 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96115a-5277-4afe-b28f-55f4114f9017 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:28.092869 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 7/13] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:28.115470 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cd218-ab7b-419b-86de-ebf9085f4891 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:28.182959 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96115a-5277-4afe-b28f-55f4114f9017 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:28.213564 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cd218-ab7b-419b-86de-ebf9085f4891 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:28.217087 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746fe6a-763c-435c-8a41-3866e53defe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:28.217930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746fe6a-763c-435c-8a41-3866e53defe6 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:28.218213 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746fe6a-763c-435c-8a41-3866e53defe6 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:28.218488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746fe6a-763c-435c-8a41-3866e53defe6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:28.229912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746fe6a-763c-435c-8a41-3866e53defe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:28.241344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-e746fe6a-763c-435c-8a41-3866e53defe6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:46:28.241344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:28.241344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:28.241344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:28.241344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:28.241344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:28.241344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:28.241344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:28.241344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:28.241344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:28.241344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:28.241344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:28.241344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:28.241344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:28.241344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:28.241344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:28.242556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:28.242556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:28.242556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:28.242556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:28.242556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:28.242556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:28.242556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:28.242556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:28.242556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:28.242556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:28.242556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:28.242556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:46:28.242556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:28.242556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:28.242556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:28.242556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:28.243600 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:28.243600 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:28.243600 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:28.243600 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:28.243600 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:28.243600 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:28.243600 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:28.243600 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:28.243600 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:28.243600 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:28.243600 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:46:28.243600 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:46:28.245970 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 7/14] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:46:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:46:28.247615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab6a61-cfc0-4107-ac63-df07b41042c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:28.248531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab6a61-cfc0-4107-ac63-df07b41042c6 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:28.248808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab6a61-cfc0-4107-ac63-df07b41042c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:28.249106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746fe6a-763c-435c-8a41-3866e53defe6 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:28.249205 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab6a61-cfc0-4107-ac63-df07b41042c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:28.315054 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab6a61-cfc0-4107-ac63-df07b41042c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:28.316590 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab6a61-cfc0-4107-ac63-df07b41042c6 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:28.343389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746fe6a-763c-435c-8a41-3866e53defe6 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:28.376704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f17e4e-2215-4c86-9190-53b326f6ea53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:28.377366 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f17e4e-2215-4c86-9190-53b326f6ea53 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:28.377661 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f17e4e-2215-4c86-9190-53b326f6ea53 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:28.377963 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f17e4e-2215-4c86-9190-53b326f6ea53 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:28.378706 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f17e4e-2215-4c86-9190-53b326f6ea53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:28.379011 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f17e4e-2215-4c86-9190-53b326f6ea53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:28.380392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f17e4e-2215-4c86-9190-53b326f6ea53 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:28.392527 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 8/15] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:46:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:28.398356 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f17e4e-2215-4c86-9190-53b326f6ea53 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:28.414948 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 8/16] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:46:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:46:28.420914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab6a61-cfc0-4107-ac63-df07b41042c6 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:28.502399 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f17e4e-2215-4c86-9190-53b326f6ea53 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:28.517399 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab6a61-cfc0-4107-ac63-df07b41042c6 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:28.538547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c04cb1-7105-4e55-bc9d-806cc36c3aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:28.539415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c04cb1-7105-4e55-bc9d-806cc36c3aa5 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:28.539665 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c04cb1-7105-4e55-bc9d-806cc36c3aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:28.539943 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c04cb1-7105-4e55-bc9d-806cc36c3aa5 None admin] PATH_INFO: `/v3/users/3409da654b054b979d2c52a756bb7ee6` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:28.541248 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c04cb1-7105-4e55-bc9d-806cc36c3aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=3409da654b054b979d2c52a756bb7ee6)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:28.542738 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c04cb1-7105-4e55-bc9d-806cc36c3aa5 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:28.544351 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 9/17] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:28 2022] GET /identity/v3/users/3409da654b054b979d2c52a756bb7ee6 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:46:28.549731 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c04cb1-7105-4e55-bc9d-806cc36c3aa5 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:28.550312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e49cde-8bfa-49e3-983c-ce531532d87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:28.551116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e49cde-8bfa-49e3-983c-ce531532d87e None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:28.551395 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e49cde-8bfa-49e3-983c-ce531532d87e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:28.551668 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e49cde-8bfa-49e3-983c-ce531532d87e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:28.655474 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c04cb1-7105-4e55-bc9d-806cc36c3aa5 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:28.682935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e49cde-8bfa-49e3-983c-ce531532d87e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:28.684412 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e49cde-8bfa-49e3-983c-ce531532d87e None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:28.691748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628093ad-a39b-4e73-9243-61ee7f034f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:28.692550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628093ad-a39b-4e73-9243-61ee7f034f8b None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:28.692826 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628093ad-a39b-4e73-9243-61ee7f034f8b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:28.693405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628093ad-a39b-4e73-9243-61ee7f034f8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:28.694319 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628093ad-a39b-4e73-9243-61ee7f034f8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:28.695730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628093ad-a39b-4e73-9243-61ee7f034f8b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:28.697436 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 10/18] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:46:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:28.704558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628093ad-a39b-4e73-9243-61ee7f034f8b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:28.707724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-98e49cde-8bfa-49e3-983c-ce531532d87e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:46:28.707724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:28.707724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:28.707724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:28.707724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:28.707724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:28.707724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:28.707724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:28.707724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:28.707724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:28.707724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:28.707724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:28.707724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:46:28.707724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:46:28.707724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:46:28.708666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:46:28.708666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:28.708666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:28.708666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:28.708666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:28.708666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:28.708666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:28.708666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:28.708666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:46:28.708666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:28.708666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:28.708666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:28.708666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:28.708666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:28.708666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:28.708666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:28.708666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:28.709518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:46:28.709518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:46:28.709518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:46:28.709518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:46:28.709722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 9/19] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:46:28.718093 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e49cde-8bfa-49e3-983c-ce531532d87e None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:28.825369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e49cde-8bfa-49e3-983c-ce531532d87e None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:28.833296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628093ad-a39b-4e73-9243-61ee7f034f8b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:28.867628 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a51c35-b6ef-45cb-9b14-1c5f1c426adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:28.868305 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a51c35-b6ef-45cb-9b14-1c5f1c426adc None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:28.868583 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a51c35-b6ef-45cb-9b14-1c5f1c426adc None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:28.869035 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a51c35-b6ef-45cb-9b14-1c5f1c426adc None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:28.869764 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a51c35-b6ef-45cb-9b14-1c5f1c426adc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:28.870103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a51c35-b6ef-45cb-9b14-1c5f1c426adc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:28.871680 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a51c35-b6ef-45cb-9b14-1c5f1c426adc None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:28.872744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c7805-ec21-4fe7-b40b-49d4fd35723d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:28.873402 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c7805-ec21-4fe7-b40b-49d4fd35723d None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:28.873684 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c7805-ec21-4fe7-b40b-49d4fd35723d None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:28.874674 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c7805-ec21-4fe7-b40b-49d4fd35723d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:28.875744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c7805-ec21-4fe7-b40b-49d4fd35723d None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.domain.id=default, user.id=3409da654b054b979d2c52a756bb7ee6) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:28.876047 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c7805-ec21-4fe7-b40b-49d4fd35723d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:28.877483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c7805-ec21-4fe7-b40b-49d4fd35723d None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:28.887875 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 11/20] 10.222.0.55 () {56 vars in 1322 bytes} [Tue May 3 09:46:28 2022] GET /identity/v3/role_assignments?user.id=3409da654b054b979d2c52a756bb7ee6&scope.domain.id=default&role.id=52d3ad3e32c741938997691c9a909b81 => generated 233 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:46:28.890681 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 10/21] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:31.588271 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9929e1-1e92-4b9f-9c98-4f234d90e391 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:31.589252 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9929e1-1e92-4b9f-9c98-4f234d90e391 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:31.589723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9929e1-1e92-4b9f-9c98-4f234d90e391 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:31.591584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 12/22] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:31.603448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470fbb1-e74f-4f50-8bb6-cb581097e8cb None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:31.604338 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470fbb1-e74f-4f50-8bb6-cb581097e8cb None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:31.604829 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470fbb1-e74f-4f50-8bb6-cb581097e8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:31.624992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-d470fbb1-e74f-4f50-8bb6-cb581097e8cb None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:31.626473 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-d470fbb1-e74f-4f50-8bb6-cb581097e8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:31.710357 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 11/23] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:31.749226 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9929e1-1e92-4b9f-9c98-4f234d90e391 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:31.792516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b621c0-2b62-4e67-9331-72b945edf10d None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:31.793449 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b621c0-2b62-4e67-9331-72b945edf10d None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:31.794172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b621c0-2b62-4e67-9331-72b945edf10d None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:31.796122 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 12/24] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:31.802437 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc04d8-6a9c-4506-8357-cb4fc621fd0a None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:31.803012 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc04d8-6a9c-4506-8357-cb4fc621fd0a None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:31.803482 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc04d8-6a9c-4506-8357-cb4fc621fd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:31.842948 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-e9fc04d8-6a9c-4506-8357-cb4fc621fd0a None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:31.844486 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-e9fc04d8-6a9c-4506-8357-cb4fc621fd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:31.867928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9929e1-1e92-4b9f-9c98-4f234d90e391 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:31.907123 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f9a18-661f-44c9-89e2-78189b5c6422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:31.908187 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9a18-661f-44c9-89e2-78189b5c6422 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:31.908596 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9a18-661f-44c9-89e2-78189b5c6422 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:31.909016 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9a18-661f-44c9-89e2-78189b5c6422 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:31.919715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f9a18-661f-44c9-89e2-78189b5c6422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:31.927957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-3a5f9a18-661f-44c9-89e2-78189b5c6422 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:46:31.927957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:31.927957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:31.927957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:31.927957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:31.927957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:31.927957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:31.927957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:31.927957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:31.927957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:31.927957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:31.927957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:31.927957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:31.927957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:31.927957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:31.927957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:31.928856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:31.928856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:31.928856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:31.928856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:31.928856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:31.928856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:31.928856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:31.928856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:31.928856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:31.928856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:31.928856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:31.928856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:46:31.928856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:31.928856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:31.928856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:31.928856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:31.929583 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:31.929583 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:31.929583 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:31.929583 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:31.929583 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:31.929583 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:31.929583 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:31.929583 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:31.929583 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:31.929583 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:31.929583 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:46:31.929583 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:46:31.932284 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 13/25] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:46:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:46:31.938722 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f9a18-661f-44c9-89e2-78189b5c6422 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:31.957851 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 13/26] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:46:31.992460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc04d8-6a9c-4506-8357-cb4fc621fd0a None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:32.121760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f9a18-661f-44c9-89e2-78189b5c6422 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:32.124314 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc04d8-6a9c-4506-8357-cb4fc621fd0a None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:32.166034 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009a11f-6ff8-4830-9be2-ee944be50eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:32.166847 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009a11f-6ff8-4830-9be2-ee944be50eb8 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:32.167126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009a11f-6ff8-4830-9be2-ee944be50eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:32.167398 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009a11f-6ff8-4830-9be2-ee944be50eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:32.184802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009a11f-6ff8-4830-9be2-ee944be50eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:32.186343 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009a11f-6ff8-4830-9be2-ee944be50eb8 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:32.200935 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba36553-e959-4624-9f1c-6c732d50c21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:32.201995 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba36553-e959-4624-9f1c-6c732d50c21b None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:32.202466 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba36553-e959-4624-9f1c-6c732d50c21b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:32.202968 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba36553-e959-4624-9f1c-6c732d50c21b None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:32.203934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba36553-e959-4624-9f1c-6c732d50c21b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:32.204442 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba36553-e959-4624-9f1c-6c732d50c21b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:32.206108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba36553-e959-4624-9f1c-6c732d50c21b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:32.213733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-7009a11f-6ff8-4830-9be2-ee944be50eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:46:32.213733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:32.213733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:32.213733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:32.213733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:32.213733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:32.213733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:32.213733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:32.213733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:32.213733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:32.213733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:32.213733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:32.213733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:46:32.213733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:46:32.213733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:46:32.214610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:46:32.214610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:32.214610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:32.214610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:32.214610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:32.214610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:32.214610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:32.214610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:32.214610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:46:32.214610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:32.214610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:32.214610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:32.214610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:32.214610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:32.214610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:32.214610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:32.214610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:32.215483 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:46:32.215483 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:46:32.215483 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:46:32.215483 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:46:32.215483 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 14/27] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:46:32.215483 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009a11f-6ff8-4830-9be2-ee944be50eb8 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:32.236167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 14/28] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:46:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:32.246949 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba36553-e959-4624-9f1c-6c732d50c21b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:32.379192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009a11f-6ff8-4830-9be2-ee944be50eb8 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:32.427237 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd76b90-c896-4e95-8aff-6562258199f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:32.427910 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd76b90-c896-4e95-8aff-6562258199f1 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:32.429024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd76b90-c896-4e95-8aff-6562258199f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:32.430372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd76b90-c896-4e95-8aff-6562258199f1 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:32.432758 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd76b90-c896-4e95-8aff-6562258199f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:32.433073 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd76b90-c896-4e95-8aff-6562258199f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:32.434485 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd76b90-c896-4e95-8aff-6562258199f1 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:32.442762 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba36553-e959-4624-9f1c-6c732d50c21b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:32.455396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 15/29] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:46:32.457519 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80ee7f-9af2-4d26-b1d9-7b7702ef3671 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:32.457828 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80ee7f-9af2-4d26-b1d9-7b7702ef3671 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:32.458292 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80ee7f-9af2-4d26-b1d9-7b7702ef3671 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:32.465916 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 16/30] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:32.466706 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80ee7f-9af2-4d26-b1d9-7b7702ef3671 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:32.490048 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a17c1-22e9-40d2-9c58-09942d743a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:32.490927 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a17c1-22e9-40d2-9c58-09942d743a05 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:32.491209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a17c1-22e9-40d2-9c58-09942d743a05 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:32.491482 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a17c1-22e9-40d2-9c58-09942d743a05 None admin] PATH_INFO: `/v3/users/3409da654b054b979d2c52a756bb7ee6` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:32.493373 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a17c1-22e9-40d2-9c58-09942d743a05 None admin] RBAC: Authorizing `identity:get_user(user_id=3409da654b054b979d2c52a756bb7ee6)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:32.495224 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a17c1-22e9-40d2-9c58-09942d743a05 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:32.497639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 15/31] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:32 2022] GET /identity/v3/users/3409da654b054b979d2c52a756bb7ee6 => generated 247 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:32.499555 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843c5fb-be14-4e7d-a339-0e33e4f27a04 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:32.499850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843c5fb-be14-4e7d-a339-0e33e4f27a04 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:32.500126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843c5fb-be14-4e7d-a339-0e33e4f27a04 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:32.502237 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 16/32] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:32.507053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aac818-a458-4bfb-ab34-1bf7371dec7d None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:32.507343 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aac818-a458-4bfb-ab34-1bf7371dec7d None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:32.507934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aac818-a458-4bfb-ab34-1bf7371dec7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:32.530977 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-d1aac818-a458-4bfb-ab34-1bf7371dec7d None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:32.532429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-d1aac818-a458-4bfb-ab34-1bf7371dec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:32.590034 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80ee7f-9af2-4d26-b1d9-7b7702ef3671 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:32.599775 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 17/33] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:32.601226 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aac818-a458-4bfb-ab34-1bf7371dec7d None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:32.640237 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2c90f-f768-424b-9de9-50e17232c1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:32.641512 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2c90f-f768-424b-9de9-50e17232c1d4 None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:32.642000 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2c90f-f768-424b-9de9-50e17232c1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:32.642449 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2c90f-f768-424b-9de9-50e17232c1d4 None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:32.643610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2c90f-f768-424b-9de9-50e17232c1d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:32.645254 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2c90f-f768-424b-9de9-50e17232c1d4 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:32.722615 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aac818-a458-4bfb-ab34-1bf7371dec7d None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:32.755152 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec53dc4-efb2-4910-9375-a2b94b27aebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:32.755955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec53dc4-efb2-4910-9375-a2b94b27aebd None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:32.756265 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec53dc4-efb2-4910-9375-a2b94b27aebd None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:32.756536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec53dc4-efb2-4910-9375-a2b94b27aebd None admin] PATH_INFO: `/v3/domains/default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:32.758062 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec53dc4-efb2-4910-9375-a2b94b27aebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:32.759540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec53dc4-efb2-4910-9375-a2b94b27aebd None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:32.766204 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 18/34] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:46:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:32.766204 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2867428-e1e2-4dd1-99b6-941819e7d24f None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:32.766204 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2867428-e1e2-4dd1-99b6-941819e7d24f None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:32.766204 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2867428-e1e2-4dd1-99b6-941819e7d24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:32.781225 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-d2867428-e1e2-4dd1-99b6-941819e7d24f None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:32.782414 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-d2867428-e1e2-4dd1-99b6-941819e7d24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:32.782814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 17/35] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 3 09:46:32 2022] POST /identity/v3/projects => generated 301 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:46:32.783802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2c90f-f768-424b-9de9-50e17232c1d4 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:32.862077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 19/36] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:32.863575 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608f2fa-0480-40e9-8957-94415edb1dc1 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:32.863861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608f2fa-0480-40e9-8957-94415edb1dc1 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:32.864135 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608f2fa-0480-40e9-8957-94415edb1dc1 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:32.865502 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 20/37] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:32.866232 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608f2fa-0480-40e9-8957-94415edb1dc1 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:32.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2c90f-f768-424b-9de9-50e17232c1d4 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:32.933909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b3a61-96f1-4ef7-b116-ba08ecc3765e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:32.934621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b3a61-96f1-4ef7-b116-ba08ecc3765e None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:32.934926 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b3a61-96f1-4ef7-b116-ba08ecc3765e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:32.935231 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b3a61-96f1-4ef7-b116-ba08ecc3765e None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:32.936052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b3a61-96f1-4ef7-b116-ba08ecc3765e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:32.937672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b3a61-96f1-4ef7-b116-ba08ecc3765e None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:32.961937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 18/38] 10.222.0.55 () {60 vars in 1131 bytes} [Tue May 3 09:46:32 2022] POST /identity/v3/roles => generated 219 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:46:32.963501 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3495e-7561-435e-be7f-c3ac27b9160c None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:32.963906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3495e-7561-435e-be7f-c3ac27b9160c None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:32.964189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3495e-7561-435e-be7f-c3ac27b9160c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:32.991140 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608f2fa-0480-40e9-8957-94415edb1dc1 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:32.996794 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-8cc3495e-7561-435e-be7f-c3ac27b9160c None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:32.998637 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-8cc3495e-7561-435e-be7f-c3ac27b9160c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:33.039452 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b3775-6519-4f43-9ae0-467e179c25af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:33.041857 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b3775-6519-4f43-9ae0-467e179c25af None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:33.042145 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b3775-6519-4f43-9ae0-467e179c25af None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:33.042426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b3775-6519-4f43-9ae0-467e179c25af None admin] PATH_INFO: `/v3/domains/default/users/3409da654b054b979d2c52a756bb7ee6/roles/52d3ad3e32c741938997691c9a909b81` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:33.044848 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b3775-6519-4f43-9ae0-467e179c25af None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3409da654b054b979d2c52a756bb7ee6, role_id=52d3ad3e32c741938997691c9a909b81)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:33.047093 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b3775-6519-4f43-9ae0-467e179c25af None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:33.084738 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 19/39] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:33.085668 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3495e-7561-435e-be7f-c3ac27b9160c None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:33.201108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 21/40] 10.222.0.55 () {58 vars in 1361 bytes} [Tue May 3 09:46:32 2022] PUT /identity/v3/domains/default/users/3409da654b054b979d2c52a756bb7ee6/roles/52d3ad3e32c741938997691c9a909b81 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:46:33.202352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b3775-6519-4f43-9ae0-467e179c25af None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:33.225761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3495e-7561-435e-be7f-c3ac27b9160c None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:33.273479 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4721cf6-3558-443f-80cf-3c8878698fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:33.274244 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4721cf6-3558-443f-80cf-3c8878698fa1 None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:33.274614 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4721cf6-3558-443f-80cf-3c8878698fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:33.274931 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4721cf6-3558-443f-80cf-3c8878698fa1 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:33.275701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4721cf6-3558-443f-80cf-3c8878698fa1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:33.277183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4721cf6-3558-443f-80cf-3c8878698fa1 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:33.297763 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 20/41] 10.222.0.55 () {60 vars in 1131 bytes} [Tue May 3 09:46:33 2022] POST /identity/v3/roles => generated 225 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:46:33.341087 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b3775-6519-4f43-9ae0-467e179c25af None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:33.383948 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa65414-0085-4b37-9707-0a94fb1acd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:33.384905 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa65414-0085-4b37-9707-0a94fb1acd85 None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:33.385324 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa65414-0085-4b37-9707-0a94fb1acd85 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:33.385763 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa65414-0085-4b37-9707-0a94fb1acd85 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:33.386726 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa65414-0085-4b37-9707-0a94fb1acd85 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:33.388556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa65414-0085-4b37-9707-0a94fb1acd85 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:33.412502 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 22/42] 10.222.0.55 () {60 vars in 1131 bytes} [Tue May 3 09:46:33 2022] POST /identity/v3/roles => generated 223 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:46:33.415040 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4b20-857b-4be5-9cf9-cada6c4e4960 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:33.415040 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4b20-857b-4be5-9cf9-cada6c4e4960 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:33.415040 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4b20-857b-4be5-9cf9-cada6c4e4960 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:33.416643 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 21/43] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:46:33.423990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec0c13-18e6-4f45-b44d-2ff0321f067c None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:33.424587 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec0c13-18e6-4f45-b44d-2ff0321f067c None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:33.425069 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec0c13-18e6-4f45-b44d-2ff0321f067c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:33.445484 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-fdec0c13-18e6-4f45-b44d-2ff0321f067c None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:33.448054 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-fdec0c13-18e6-4f45-b44d-2ff0321f067c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:33.525635 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 23/44] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:33.550034 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b4b20-857b-4be5-9cf9-cada6c4e4960 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:33.659324 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b4b20-857b-4be5-9cf9-cada6c4e4960 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:33.691750 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4dd93-5d57-408b-93be-2b9307dbcf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:33.692545 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4dd93-5d57-408b-93be-2b9307dbcf7e None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:33.692823 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4dd93-5d57-408b-93be-2b9307dbcf7e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:33.693096 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4dd93-5d57-408b-93be-2b9307dbcf7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:33.694277 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4dd93-5d57-408b-93be-2b9307dbcf7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:33.695726 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4dd93-5d57-408b-93be-2b9307dbcf7e None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:33.697379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 22/45] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:46:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:33.703000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec0c13-18e6-4f45-b44d-2ff0321f067c None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:33.801005 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec0c13-18e6-4f45-b44d-2ff0321f067c None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:33.836354 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63fb39-734b-41a8-9608-ac1a25b7e2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:33.837138 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63fb39-734b-41a8-9608-ac1a25b7e2ff None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:33.837472 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63fb39-734b-41a8-9608-ac1a25b7e2ff None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:33.837700 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63fb39-734b-41a8-9608-ac1a25b7e2ff None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:33.838445 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63fb39-734b-41a8-9608-ac1a25b7e2ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:33.839911 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63fb39-734b-41a8-9608-ac1a25b7e2ff None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:33.866777 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 24/46] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 3 09:46:33 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:46:35.502590 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b727a-a6d5-4cf3-8688-76df76c1bba8 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:35.503098 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b727a-a6d5-4cf3-8688-76df76c1bba8 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:35.503206 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b727a-a6d5-4cf3-8688-76df76c1bba8 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:35.504555 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 23/47] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:35.510398 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a1ef2-5546-47d9-a879-3193b03f8f9d None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:35.510814 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a1ef2-5546-47d9-a879-3193b03f8f9d None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:35.511015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a1ef2-5546-47d9-a879-3193b03f8f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:35.528087 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-068a1ef2-5546-47d9-a879-3193b03f8f9d None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:35.529256 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-068a1ef2-5546-47d9-a879-3193b03f8f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:35.594485 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 25/48] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:46:35.617146 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b727a-a6d5-4cf3-8688-76df76c1bba8 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:35.719670 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b727a-a6d5-4cf3-8688-76df76c1bba8 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:35.753155 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e229b25-f648-49cb-b71d-cfc382363a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:35.753975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e229b25-f648-49cb-b71d-cfc382363a79 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:35.754253 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e229b25-f648-49cb-b71d-cfc382363a79 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:35.754522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e229b25-f648-49cb-b71d-cfc382363a79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:35.766648 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e229b25-f648-49cb-b71d-cfc382363a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:35.775369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-5e229b25-f648-49cb-b71d-cfc382363a79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:46:35.775369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:35.775369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:35.775369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:35.775369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:35.775369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:35.775369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:35.775369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:35.775369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:35.775369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:35.775369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:35.775369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:35.775369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:35.775369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:35.775369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:35.775369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:35.776325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:35.776325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:35.776325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:35.776325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:35.776325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:35.776325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:35.776325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:35.776325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:35.776325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:35.776325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:35.776325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:35.776325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:46:35.776325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:35.776325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:35.776325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:35.776325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:35.777076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:35.777076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:35.777076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:35.777076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:35.777076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:35.777076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:35.777076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:35.777076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:35.777076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:35.777076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:35.777076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:46:35.777076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:46:35.777076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 24/49] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:46:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:46:35.782459 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a1ef2-5546-47d9-a879-3193b03f8f9d None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:35.874891 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a1ef2-5546-47d9-a879-3193b03f8f9d None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:35.907890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d37acc-a4cb-4f78-9b9c-e51889c7708c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:35.908555 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d37acc-a4cb-4f78-9b9c-e51889c7708c None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:35.908833 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d37acc-a4cb-4f78-9b9c-e51889c7708c None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:35.909105 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d37acc-a4cb-4f78-9b9c-e51889c7708c None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:35.909832 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d37acc-a4cb-4f78-9b9c-e51889c7708c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:35.910169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d37acc-a4cb-4f78-9b9c-e51889c7708c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:35.911560 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d37acc-a4cb-4f78-9b9c-e51889c7708c None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:35.919781 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 26/50] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:46:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:35.925743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e229b25-f648-49cb-b71d-cfc382363a79 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:36.030504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e229b25-f648-49cb-b71d-cfc382363a79 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:36.065850 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489a86e-10d6-4d00-b6e8-0ee2078448a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:36.066764 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489a86e-10d6-4d00-b6e8-0ee2078448a1 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:36.067049 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489a86e-10d6-4d00-b6e8-0ee2078448a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:36.067325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489a86e-10d6-4d00-b6e8-0ee2078448a1 None admin] PATH_INFO: `/v3/users/3409da654b054b979d2c52a756bb7ee6` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:36.068814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489a86e-10d6-4d00-b6e8-0ee2078448a1 None admin] RBAC: Authorizing `identity:get_user(user_id=3409da654b054b979d2c52a756bb7ee6)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:36.070324 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489a86e-10d6-4d00-b6e8-0ee2078448a1 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:36.072163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 25/51] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:35 2022] GET /identity/v3/users/3409da654b054b979d2c52a756bb7ee6 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:36.077771 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d37acc-a4cb-4f78-9b9c-e51889c7708c None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:36.181012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d37acc-a4cb-4f78-9b9c-e51889c7708c None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:36.208628 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f60935-ddff-43eb-be3f-c23dcb96920d None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:36.208889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f60935-ddff-43eb-be3f-c23dcb96920d None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:36.209190 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f60935-ddff-43eb-be3f-c23dcb96920d None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:36.210613 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 26/52] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:46:36.214435 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356be043-c74d-4a19-931d-75991b743e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:36.215033 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356be043-c74d-4a19-931d-75991b743e47 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:36.215310 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356be043-c74d-4a19-931d-75991b743e47 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:36.215544 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649a7e6-220b-46aa-8bdd-34049dbd719e None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:36.215633 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356be043-c74d-4a19-931d-75991b743e47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:36.215830 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649a7e6-220b-46aa-8bdd-34049dbd719e None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:36.216100 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649a7e6-220b-46aa-8bdd-34049dbd719e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:36.216875 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356be043-c74d-4a19-931d-75991b743e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:36.218394 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356be043-c74d-4a19-931d-75991b743e47 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:36.220043 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 27/53] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:46:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:36.225893 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356be043-c74d-4a19-931d-75991b743e47 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:36.232212 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-0649a7e6-220b-46aa-8bdd-34049dbd719e None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:36.233395 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-0649a7e6-220b-46aa-8bdd-34049dbd719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:36.296625 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 27/54] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:46:36.319646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649a7e6-220b-46aa-8bdd-34049dbd719e None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:36.325185 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356be043-c74d-4a19-931d-75991b743e47 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:36.355848 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44973553-e68e-4e4f-8f2d-b45d478e6184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:36.356497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44973553-e68e-4e4f-8f2d-b45d478e6184 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:36.356777 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44973553-e68e-4e4f-8f2d-b45d478e6184 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:36.357029 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44973553-e68e-4e4f-8f2d-b45d478e6184 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:36.357884 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44973553-e68e-4e4f-8f2d-b45d478e6184 None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.domain.id=default, user.id=3409da654b054b979d2c52a756bb7ee6) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:36.358190 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44973553-e68e-4e4f-8f2d-b45d478e6184 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:36.359609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44973553-e68e-4e4f-8f2d-b45d478e6184 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:36.365143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 28/55] 10.222.0.55 () {56 vars in 1322 bytes} [Tue May 3 09:46:36 2022] GET /identity/v3/role_assignments?user.id=3409da654b054b979d2c52a756bb7ee6&scope.domain.id=default&role.id=52d3ad3e32c741938997691c9a909b81 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:36.424381 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649a7e6-220b-46aa-8bdd-34049dbd719e None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:36.462004 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6584a-7a4e-40b8-9534-273c1df3b5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:36.462743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6584a-7a4e-40b8-9534-273c1df3b5a7 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:36.462982 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6584a-7a4e-40b8-9534-273c1df3b5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:36.463238 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6584a-7a4e-40b8-9534-273c1df3b5a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:36.464560 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6584a-7a4e-40b8-9534-273c1df3b5a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:36.466081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6584a-7a4e-40b8-9534-273c1df3b5a7 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:36.467761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 28/56] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:46:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:46:36.473644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44973553-e68e-4e4f-8f2d-b45d478e6184 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:36.577009 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44973553-e68e-4e4f-8f2d-b45d478e6184 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:36.608743 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bacb0c-8078-4bb6-8731-80444dd19779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:36.609407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bacb0c-8078-4bb6-8731-80444dd19779 None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:36.609688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bacb0c-8078-4bb6-8731-80444dd19779 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:36.610127 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bacb0c-8078-4bb6-8731-80444dd19779 None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:36.610835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bacb0c-8078-4bb6-8731-80444dd19779 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:36.612294 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bacb0c-8078-4bb6-8731-80444dd19779 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:36.639230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 29/57] 10.222.0.55 () {60 vars in 1140 bytes} [Tue May 3 09:46:36 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:46:38.861598 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f76fa3-39a6-4918-95a7-b8793328e4a2 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:38.862481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f76fa3-39a6-4918-95a7-b8793328e4a2 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:38.862481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f76fa3-39a6-4918-95a7-b8793328e4a2 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:38.864637 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 29/58] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:38.871637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defa819-6897-4fa7-933d-680323cce92b None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:38.872065 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defa819-6897-4fa7-933d-680323cce92b None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:38.872150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defa819-6897-4fa7-933d-680323cce92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:38.890024 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-8defa819-6897-4fa7-933d-680323cce92b None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:38.891185 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-8defa819-6897-4fa7-933d-680323cce92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:38.958110 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 30/59] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:46:38.983674 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f76fa3-39a6-4918-95a7-b8793328e4a2 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:39.110618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f76fa3-39a6-4918-95a7-b8793328e4a2 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:39.154782 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b4b29-1fce-41e4-b19f-f3c262f27a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:39.155486 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b4b29-1fce-41e4-b19f-f3c262f27a2a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:39.155762 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b4b29-1fce-41e4-b19f-f3c262f27a2a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:39.156025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b4b29-1fce-41e4-b19f-f3c262f27a2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:39.157226 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b4b29-1fce-41e4-b19f-f3c262f27a2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:39.158702 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b4b29-1fce-41e4-b19f-f3c262f27a2a None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:39.160278 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 30/60] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:46:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:39.166824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defa819-6897-4fa7-933d-680323cce92b None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:39.281197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defa819-6897-4fa7-933d-680323cce92b None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:39.316057 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce9d3d-52e6-466b-a3e3-8258e3eb743b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:39.316722 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9d3d-52e6-466b-a3e3-8258e3eb743b None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:39.317004 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9d3d-52e6-466b-a3e3-8258e3eb743b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:39.317274 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9d3d-52e6-466b-a3e3-8258e3eb743b None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:39.318003 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce9d3d-52e6-466b-a3e3-8258e3eb743b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:39.319453 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce9d3d-52e6-466b-a3e3-8258e3eb743b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:39.346732 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 31/61] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:46:39 2022] POST /identity/v3/users => generated 275 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:46:42.669295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf15d83-0ffb-4eb2-bbac-452a6456fe3e None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:42.670252 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf15d83-0ffb-4eb2-bbac-452a6456fe3e None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:42.670744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf15d83-0ffb-4eb2-bbac-452a6456fe3e None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:42.672589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 31/62] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:42.677497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c4024-1bf1-4daa-a9f2-3237e9660649 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:42.677934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c4024-1bf1-4daa-a9f2-3237e9660649 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:42.678082 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c4024-1bf1-4daa-a9f2-3237e9660649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:42.699317 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-fd5c4024-1bf1-4daa-a9f2-3237e9660649 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:42.700729 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-fd5c4024-1bf1-4daa-a9f2-3237e9660649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:42.755260 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e079e-473d-436c-8e0b-5633605a9f0e None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:42.755888 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e079e-473d-436c-8e0b-5633605a9f0e None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:42.756359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e079e-473d-436c-8e0b-5633605a9f0e None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:42.758631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 32/63] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:42.775211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ed5c6-b890-4651-aac9-b3ff2cd31e7e None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:42.775821 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ed5c6-b890-4651-aac9-b3ff2cd31e7e None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:42.782196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ed5c6-b890-4651-aac9-b3ff2cd31e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:42.785741 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 32/64] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:42.809699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-eb7ed5c6-b890-4651-aac9-b3ff2cd31e7e None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:42.810021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c4024-1bf1-4daa-a9f2-3237e9660649 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:42.811327 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-eb7ed5c6-b890-4651-aac9-b3ff2cd31e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:42.915049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c4024-1bf1-4daa-a9f2-3237e9660649 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:42.950447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 33/65] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:46:42.955880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835ea5f-870a-455b-8275-8c648f1044f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:42.956705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835ea5f-870a-455b-8275-8c648f1044f7 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:42.956987 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835ea5f-870a-455b-8275-8c648f1044f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:42.957263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835ea5f-870a-455b-8275-8c648f1044f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:42.973960 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835ea5f-870a-455b-8275-8c648f1044f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:42.974448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ed5c6-b890-4651-aac9-b3ff2cd31e7e None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:42.984578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-8835ea5f-870a-455b-8275-8c648f1044f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:46:42.984578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:42.984578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:42.984578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:42.984578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:42.984578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:42.984578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:42.984578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:42.984578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:42.984578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:42.984578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:42.984578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:42.984578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:42.984578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:42.984578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:42.984578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:42.985656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:42.985656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:42.985656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:42.985656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:42.985656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:42.985656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:42.985656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:42.985656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:42.985656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:42.985656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:42.985656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:42.985656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:46:42.985656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:42.985656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:42.985656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:42.985656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:42.986639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:42.986639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:42.986639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:42.986639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:42.986639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:42.986639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:42.986639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:42.986639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:42.986639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:42.986639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:42.986639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:46:42.986639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:46:42.986639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 33/66] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:46:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:46:42.994804 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835ea5f-870a-455b-8275-8c648f1044f7 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:43.094313 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ed5c6-b890-4651-aac9-b3ff2cd31e7e None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:43.106740 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835ea5f-870a-455b-8275-8c648f1044f7 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:43.129885 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5ca43-07d4-43d0-ab90-de5e1bf0e43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:43.130958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ca43-07d4-43d0-ab90-de5e1bf0e43a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:43.131371 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ca43-07d4-43d0-ab90-de5e1bf0e43a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:43.131774 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ca43-07d4-43d0-ab90-de5e1bf0e43a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:43.143931 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20cafc-069b-4845-ac86-441bc6b2effc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:43.144257 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5ca43-07d4-43d0-ab90-de5e1bf0e43a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:43.145037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20cafc-069b-4845-ac86-441bc6b2effc None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:43.145457 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20cafc-069b-4845-ac86-441bc6b2effc None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:43.145905 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20cafc-069b-4845-ac86-441bc6b2effc None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:43.146800 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20cafc-069b-4845-ac86-441bc6b2effc None admin] RBAC: Adding query filter params (name=member) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:43.147262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20cafc-069b-4845-ac86-441bc6b2effc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:43.148800 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20cafc-069b-4845-ac86-441bc6b2effc None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:43.152163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-61f5ca43-07d4-43d0-ab90-de5e1bf0e43a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:46:43.152163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:43.152163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:43.152163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:43.152163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:43.152163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:43.152163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:43.152163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:43.152163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:43.152163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:43.152163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:43.152163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:43.152163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:43.152163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:43.152163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:43.152163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:43.153193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:43.153193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:43.153193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:43.153193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:43.153193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:43.153193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:43.153193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:43.153193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:43.153193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:43.153193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:43.153193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:43.153193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:46:43.153193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:43.153193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:43.153193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:43.153193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:43.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:43.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:43.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:43.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:43.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:43.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:43.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:43.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:43.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:43.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:43.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:46:43.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:46:43.156387 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 34/67] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:46:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:46:43.157925 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b7a1d-df80-45a0-91e1-62c0d1ad9543 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:43.158379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b7a1d-df80-45a0-91e1-62c0d1ad9543 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:43.158816 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b7a1d-df80-45a0-91e1-62c0d1ad9543 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:43.158936 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 34/68] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:46:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:43.160305 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 35/69] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:43.162194 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20cafc-069b-4845-ac86-441bc6b2effc None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:43.165105 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b7a1d-df80-45a0-91e1-62c0d1ad9543 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:43.264092 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20cafc-069b-4845-ac86-441bc6b2effc None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:43.264263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b7a1d-df80-45a0-91e1-62c0d1ad9543 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:43.298150 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055287a-095a-4396-a1bd-6121be30024b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:43.299432 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055287a-095a-4396-a1bd-6121be30024b None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:43.299963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055287a-095a-4396-a1bd-6121be30024b None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:43.300373 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055287a-095a-4396-a1bd-6121be30024b None admin] PATH_INFO: `/v3/users/73fc2af7c3ea4c41af7c840384744887` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:43.301132 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d6f71-6cf9-4a71-bfeb-873c6eff245c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:43.301964 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d6f71-6cf9-4a71-bfeb-873c6eff245c None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:43.302466 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d6f71-6cf9-4a71-bfeb-873c6eff245c None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:43.302946 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d6f71-6cf9-4a71-bfeb-873c6eff245c None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:43.303923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d6f71-6cf9-4a71-bfeb-873c6eff245c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:43.304448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d6f71-6cf9-4a71-bfeb-873c6eff245c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:43.306197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d6f71-6cf9-4a71-bfeb-873c6eff245c None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:43.315709 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 35/70] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:46:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:43.317242 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99c9d7-e1fc-4827-a212-e7f6dec328eb None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:43.317533 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99c9d7-e1fc-4827-a212-e7f6dec328eb None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:43.317846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99c9d7-e1fc-4827-a212-e7f6dec328eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:43.318398 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055287a-095a-4396-a1bd-6121be30024b None admin] RBAC: Authorizing `identity:get_user(user_id=73fc2af7c3ea4c41af7c840384744887)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:43.320215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055287a-095a-4396-a1bd-6121be30024b None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:43.322348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 36/71] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:43 2022] GET /identity/v3/users/73fc2af7c3ea4c41af7c840384744887 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:43.323868 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdaa3d-44f0-473b-8dfe-c0d36cec300c None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:43.324323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdaa3d-44f0-473b-8dfe-c0d36cec300c None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:43.324769 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdaa3d-44f0-473b-8dfe-c0d36cec300c None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:43.326258 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 37/72] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:43.327144 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdaa3d-44f0-473b-8dfe-c0d36cec300c None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:43.336294 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-aa99c9d7-e1fc-4827-a212-e7f6dec328eb None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:43.337625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-aa99c9d7-e1fc-4827-a212-e7f6dec328eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:43.405034 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 36/73] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:43.406271 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99c9d7-e1fc-4827-a212-e7f6dec328eb None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:43.431121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdaa3d-44f0-473b-8dfe-c0d36cec300c None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:43.464242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0c34f-c8a9-49a4-b69a-ea010dcdf06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:43.465117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0c34f-c8a9-49a4-b69a-ea010dcdf06d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:43.465394 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0c34f-c8a9-49a4-b69a-ea010dcdf06d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:43.466025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0c34f-c8a9-49a4-b69a-ea010dcdf06d None admin] PATH_INFO: `/v3/users/3409da654b054b979d2c52a756bb7ee6` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:43.466970 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0c34f-c8a9-49a4-b69a-ea010dcdf06d None admin] RBAC: Authorizing `identity:get_user(user_id=3409da654b054b979d2c52a756bb7ee6)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:43.468327 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0c34f-c8a9-49a4-b69a-ea010dcdf06d None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:43.469989 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 38/74] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:43 2022] GET /identity/v3/users/3409da654b054b979d2c52a756bb7ee6 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:43.471110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be6fa5-c58c-497c-8f1b-b140ecd8f811 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:43.471388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be6fa5-c58c-497c-8f1b-b140ecd8f811 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:43.471873 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be6fa5-c58c-497c-8f1b-b140ecd8f811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:43.488437 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-b9be6fa5-c58c-497c-8f1b-b140ecd8f811 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:43.489088 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-b9be6fa5-c58c-497c-8f1b-b140ecd8f811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:43.513372 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99c9d7-e1fc-4827-a212-e7f6dec328eb None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:43.544319 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac628b-e33b-4fb7-a84e-bfa4a1219ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:43.544970 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac628b-e33b-4fb7-a84e-bfa4a1219ad2 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:43.545249 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac628b-e33b-4fb7-a84e-bfa4a1219ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:43.545517 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac628b-e33b-4fb7-a84e-bfa4a1219ad2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:43.551287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 39/75] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:43.552125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be6fa5-c58c-497c-8f1b-b140ecd8f811 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:43.613065 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac628b-e33b-4fb7-a84e-bfa4a1219ad2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:43.614569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac628b-e33b-4fb7-a84e-bfa4a1219ad2 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:43.647133 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be6fa5-c58c-497c-8f1b-b140ecd8f811 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:43.678639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87dbf9-2906-4d22-86bf-30a35e23d340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:43.679438 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87dbf9-2906-4d22-86bf-30a35e23d340 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:43.679720 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87dbf9-2906-4d22-86bf-30a35e23d340 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:43.679996 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87dbf9-2906-4d22-86bf-30a35e23d340 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:43.689823 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87dbf9-2906-4d22-86bf-30a35e23d340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:43.697785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-5c87dbf9-2906-4d22-86bf-30a35e23d340 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:46:43.697785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:43.697785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:43.697785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:43.697785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:43.697785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:43.697785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:43.697785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:43.697785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:43.697785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:43.697785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:43.697785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:43.697785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:43.697785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:43.697785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:43.697785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:43.698658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:43.698658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:43.698658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:43.698658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:43.698658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:43.698658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:43.698658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:43.698658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:43.698658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:43.698658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:43.698658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:43.698658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:46:43.698658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:43.698658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:43.698658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:43.698658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:43.699417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:43.699417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:43.699417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:43.699417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:43.699417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:43.699417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:43.699417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:43.699417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:43.699417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:43.699417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:43.699417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:46:43.699417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:46:43.699417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 40/76] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:46:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:46:43.700379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87dbf9-2906-4d22-86bf-30a35e23d340 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:43.712425 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 37/77] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:46:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:46:43.714898 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e126-3b45-482d-80f2-9425414a17fd None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:43.715188 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e126-3b45-482d-80f2-9425414a17fd None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:43.715461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e126-3b45-482d-80f2-9425414a17fd None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:43.716875 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 38/78] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:43.718612 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36e126-3b45-482d-80f2-9425414a17fd None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:43.797411 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87dbf9-2906-4d22-86bf-30a35e23d340 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:43.817542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36e126-3b45-482d-80f2-9425414a17fd None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:43.832734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb19f32-c488-4c50-a354-9c71d4fec68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:43.833388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb19f32-c488-4c50-a354-9c71d4fec68d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:43.833665 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb19f32-c488-4c50-a354-9c71d4fec68d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:43.833964 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb19f32-c488-4c50-a354-9c71d4fec68d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:43.854783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ed1a2-50f5-4d21-bdb6-6f7e12d89216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:43.855581 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ed1a2-50f5-4d21-bdb6-6f7e12d89216 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:43.855860 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ed1a2-50f5-4d21-bdb6-6f7e12d89216 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:43.856131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ed1a2-50f5-4d21-bdb6-6f7e12d89216 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:43.866034 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ed1a2-50f5-4d21-bdb6-6f7e12d89216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:43.873880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-8d8ed1a2-50f5-4d21-bdb6-6f7e12d89216 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:46:43.873880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:43.873880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:43.873880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:43.873880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:43.873880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:43.873880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:43.873880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:43.873880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:43.873880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:43.873880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:43.873880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:43.873880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:43.873880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:43.873880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:43.873880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:43.874851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:43.874851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:43.874851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:43.874851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:43.874851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:43.874851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:43.874851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:43.874851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:43.874851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:43.874851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:43.874851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:43.874851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:46:43.874851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:43.874851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:43.874851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:43.874851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:43.875609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:43.875609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:43.875609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:43.875609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:43.875609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:43.875609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:43.875609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:43.875609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:43.875609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:43.875609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:43.875609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:46:43.875609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:46:43.875609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 39/79] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:46:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:46:43.877327 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ed1a2-50f5-4d21-bdb6-6f7e12d89216 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:43.902521 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb19f32-c488-4c50-a354-9c71d4fec68d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:43.904186 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb19f32-c488-4c50-a354-9c71d4fec68d None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:43.970295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ed1a2-50f5-4d21-bdb6-6f7e12d89216 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:43.999488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 41/80] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:46:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:46:44.000325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb19f32-c488-4c50-a354-9c71d4fec68d None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:44.005163 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91d075-02fb-458b-9d31-279f79485ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:44.005821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91d075-02fb-458b-9d31-279f79485ffb None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:44.006162 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91d075-02fb-458b-9d31-279f79485ffb None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:44.006440 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91d075-02fb-458b-9d31-279f79485ffb None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:44.007191 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91d075-02fb-458b-9d31-279f79485ffb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:44.007808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91d075-02fb-458b-9d31-279f79485ffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:44.009216 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91d075-02fb-458b-9d31-279f79485ffb None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:44.017399 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 40/81] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:46:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:44.018812 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb618b-798b-4571-a665-72b8a7303cab None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:44.019032 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb618b-798b-4571-a665-72b8a7303cab None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:44.019292 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb618b-798b-4571-a665-72b8a7303cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:44.035109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-e2cb618b-798b-4571-a665-72b8a7303cab None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:44.036295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-e2cb618b-798b-4571-a665-72b8a7303cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:44.095229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb19f32-c488-4c50-a354-9c71d4fec68d None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:44.097039 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 41/82] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:44.099190 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb618b-798b-4571-a665-72b8a7303cab None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:44.131261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b041943-3018-4246-9ca7-b1e06d35a17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:44.132127 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b041943-3018-4246-9ca7-b1e06d35a17b None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:44.132708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b041943-3018-4246-9ca7-b1e06d35a17b None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:44.132988 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b041943-3018-4246-9ca7-b1e06d35a17b None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:44.134300 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b041943-3018-4246-9ca7-b1e06d35a17b None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:44.135743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b041943-3018-4246-9ca7-b1e06d35a17b None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:44.137581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 42/83] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:46:43 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:44.138288 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b041943-3018-4246-9ca7-b1e06d35a17b None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:44.192294 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb618b-798b-4571-a665-72b8a7303cab None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:44.224707 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eb25d-2482-4d97-8286-9ad0588e6f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:44.225375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb25d-2482-4d97-8286-9ad0588e6f93 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:44.225633 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb25d-2482-4d97-8286-9ad0588e6f93 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:44.225936 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb25d-2482-4d97-8286-9ad0588e6f93 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:44.226694 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451eb25d-2482-4d97-8286-9ad0588e6f93 None admin] RBAC: Adding query filter params (name=member) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:44.227003 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451eb25d-2482-4d97-8286-9ad0588e6f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:44.228634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451eb25d-2482-4d97-8286-9ad0588e6f93 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:44.234786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b041943-3018-4246-9ca7-b1e06d35a17b None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:44.240759 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 42/84] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:46:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:44.240759 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eb25d-2482-4d97-8286-9ad0588e6f93 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:44.268756 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79d9d6-eff5-42be-820a-85b68813483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:44.269606 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79d9d6-eff5-42be-820a-85b68813483d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:44.269924 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79d9d6-eff5-42be-820a-85b68813483d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:44.270197 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79d9d6-eff5-42be-820a-85b68813483d None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:44.271380 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79d9d6-eff5-42be-820a-85b68813483d None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:44.272810 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79d9d6-eff5-42be-820a-85b68813483d None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:44.274515 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 43/85] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:46:44 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:44.275273 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79d9d6-eff5-42be-820a-85b68813483d None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:44.340000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eb25d-2482-4d97-8286-9ad0588e6f93 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:44.367341 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79d9d6-eff5-42be-820a-85b68813483d None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:44.372097 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59c41b-2b48-462e-a011-d8d39e2b09a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:44.372980 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59c41b-2b48-462e-a011-d8d39e2b09a8 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:44.373264 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59c41b-2b48-462e-a011-d8d39e2b09a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:44.373538 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59c41b-2b48-462e-a011-d8d39e2b09a8 None admin] PATH_INFO: `/v3/users/73fc2af7c3ea4c41af7c840384744887` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:44.374754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59c41b-2b48-462e-a011-d8d39e2b09a8 None admin] RBAC: Authorizing `identity:get_user(user_id=73fc2af7c3ea4c41af7c840384744887)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:44.376200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59c41b-2b48-462e-a011-d8d39e2b09a8 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:44.377918 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 43/86] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:44 2022] GET /identity/v3/users/73fc2af7c3ea4c41af7c840384744887 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:44.378669 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59c41b-2b48-462e-a011-d8d39e2b09a8 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:44.401944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8f0a1-d7ac-46ea-8b68-11a53fc1ad4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:44.402739 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8f0a1-d7ac-46ea-8b68-11a53fc1ad4c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:44.403015 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8f0a1-d7ac-46ea-8b68-11a53fc1ad4c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:44.403303 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8f0a1-d7ac-46ea-8b68-11a53fc1ad4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:44.404561 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8f0a1-d7ac-46ea-8b68-11a53fc1ad4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:44.406066 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8f0a1-d7ac-46ea-8b68-11a53fc1ad4c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:44.407841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 44/87] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:46:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:44.408511 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8f0a1-d7ac-46ea-8b68-11a53fc1ad4c None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:44.475454 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59c41b-2b48-462e-a011-d8d39e2b09a8 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:44.505001 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8f0a1-d7ac-46ea-8b68-11a53fc1ad4c None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:44.508907 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7274c-af0b-46d9-9eca-bd6c3def2f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:44.509565 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7274c-af0b-46d9-9eca-bd6c3def2f03 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:44.509878 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7274c-af0b-46d9-9eca-bd6c3def2f03 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:44.510155 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7274c-af0b-46d9-9eca-bd6c3def2f03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:44.510989 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7274c-af0b-46d9-9eca-bd6c3def2f03 None admin] RBAC: Adding query filter params (role.id=9e77c7f209fd4468bcf1b89bfef3c236, scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e, user.id=73fc2af7c3ea4c41af7c840384744887) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:44.511299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7274c-af0b-46d9-9eca-bd6c3def2f03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:44.512736 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7274c-af0b-46d9-9eca-bd6c3def2f03 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:44.518482 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 44/88] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:46:44 2022] GET /identity/v3/role_assignments?user.id=73fc2af7c3ea4c41af7c840384744887&scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e&role.id=9e77c7f209fd4468bcf1b89bfef3c236 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:44.519032 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7274c-af0b-46d9-9eca-bd6c3def2f03 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:44.546852 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89ee08-f69e-4c84-8dbe-a71dc5a92b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:44.547863 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89ee08-f69e-4c84-8dbe-a71dc5a92b6f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:44.548208 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89ee08-f69e-4c84-8dbe-a71dc5a92b6f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:44.548533 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89ee08-f69e-4c84-8dbe-a71dc5a92b6f None admin] PATH_INFO: `/v3/users/73fc2af7c3ea4c41af7c840384744887` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:44.549875 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89ee08-f69e-4c84-8dbe-a71dc5a92b6f None admin] RBAC: Authorizing `identity:get_user(user_id=73fc2af7c3ea4c41af7c840384744887)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:44.551375 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89ee08-f69e-4c84-8dbe-a71dc5a92b6f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:44.553084 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 45/89] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:44 2022] GET /identity/v3/users/73fc2af7c3ea4c41af7c840384744887 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:44.553909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89ee08-f69e-4c84-8dbe-a71dc5a92b6f None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:44.625303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7274c-af0b-46d9-9eca-bd6c3def2f03 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:44.654817 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89ee08-f69e-4c84-8dbe-a71dc5a92b6f None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:44.660263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a54fa8-1b13-4cd1-a704-7c7633a25c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:44.660936 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a54fa8-1b13-4cd1-a704-7c7633a25c57 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:44.661216 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a54fa8-1b13-4cd1-a704-7c7633a25c57 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:44.661488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a54fa8-1b13-4cd1-a704-7c7633a25c57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:44.662372 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a54fa8-1b13-4cd1-a704-7c7633a25c57 None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e, user.id=3409da654b054b979d2c52a756bb7ee6) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:44.662682 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a54fa8-1b13-4cd1-a704-7c7633a25c57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:44.664143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a54fa8-1b13-4cd1-a704-7c7633a25c57 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:44.670279 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 45/90] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:46:44 2022] GET /identity/v3/role_assignments?user.id=3409da654b054b979d2c52a756bb7ee6&scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e&role.id=52d3ad3e32c741938997691c9a909b81 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:44.678910 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a54fa8-1b13-4cd1-a704-7c7633a25c57 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:44.693091 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a95e4f-058e-43d9-b630-19f8e1fa443c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:44.694555 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a95e4f-058e-43d9-b630-19f8e1fa443c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:44.695096 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a95e4f-058e-43d9-b630-19f8e1fa443c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:44.695558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a95e4f-058e-43d9-b630-19f8e1fa443c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:44.772010 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a95e4f-058e-43d9-b630-19f8e1fa443c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:44.773542 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a95e4f-058e-43d9-b630-19f8e1fa443c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:44.787591 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a54fa8-1b13-4cd1-a704-7c7633a25c57 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:44.822458 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bfb71-c426-461c-b2b0-db79508e64f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:44.823169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bfb71-c426-461c-b2b0-db79508e64f5 None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:44.823446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bfb71-c426-461c-b2b0-db79508e64f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:44.823723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bfb71-c426-461c-b2b0-db79508e64f5 None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:44.824449 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bfb71-c426-461c-b2b0-db79508e64f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:44.825957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bfb71-c426-461c-b2b0-db79508e64f5 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:44.851463 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 46/91] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:46:44 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:46:44.852103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bfb71-c426-461c-b2b0-db79508e64f5 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:44.881503 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 46/92] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:46:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:46:44.887705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a95e4f-058e-43d9-b630-19f8e1fa443c None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:44.980801 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bfb71-c426-461c-b2b0-db79508e64f5 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:45.018132 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44820089-c644-4832-add0-a18fdb75d7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:45.018795 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44820089-c644-4832-add0-a18fdb75d7bb None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:45.019076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44820089-c644-4832-add0-a18fdb75d7bb None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:45.019349 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44820089-c644-4832-add0-a18fdb75d7bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:45.034241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a95e4f-058e-43d9-b630-19f8e1fa443c None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:45.095521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44820089-c644-4832-add0-a18fdb75d7bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:45.097011 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44820089-c644-4832-add0-a18fdb75d7bb None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:45.097194 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db99659-a5c3-4ef6-a5e0-73202872ba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:45.098090 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99659-a5c3-4ef6-a5e0-73202872ba81 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:45.098373 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99659-a5c3-4ef6-a5e0-73202872ba81 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:45.098646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99659-a5c3-4ef6-a5e0-73202872ba81 None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:45.102649 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db99659-a5c3-4ef6-a5e0-73202872ba81 None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:45.104122 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db99659-a5c3-4ef6-a5e0-73202872ba81 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:45.108805 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 47/93] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:46:44 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:45.112465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db99659-a5c3-4ef6-a5e0-73202872ba81 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:45.214409 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 47/94] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:46:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:46:45.220599 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44820089-c644-4832-add0-a18fdb75d7bb None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:45.232137 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db99659-a5c3-4ef6-a5e0-73202872ba81 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:45.272006 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627c351-c162-47f6-8ade-4ec8eb77fc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:45.272731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627c351-c162-47f6-8ade-4ec8eb77fc7c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:45.273018 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627c351-c162-47f6-8ade-4ec8eb77fc7c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:45.273290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627c351-c162-47f6-8ade-4ec8eb77fc7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:45.274259 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627c351-c162-47f6-8ade-4ec8eb77fc7c None admin] RBAC: Adding query filter params (role.id=cb8032f764644c90a3dc0cb396434d67, scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e, user.id=73fc2af7c3ea4c41af7c840384744887) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:45.274587 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627c351-c162-47f6-8ade-4ec8eb77fc7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:45.276023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627c351-c162-47f6-8ade-4ec8eb77fc7c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:45.289077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 48/95] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:46:45 2022] GET /identity/v3/role_assignments?user.id=73fc2af7c3ea4c41af7c840384744887&scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e&role.id=cb8032f764644c90a3dc0cb396434d67 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:46:45.332762 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44820089-c644-4832-add0-a18fdb75d7bb None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:45.376253 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486d70c-dfaa-4d9a-9bfb-c03f6afcaf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:45.377163 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486d70c-dfaa-4d9a-9bfb-c03f6afcaf90 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:45.377442 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486d70c-dfaa-4d9a-9bfb-c03f6afcaf90 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:45.377713 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486d70c-dfaa-4d9a-9bfb-c03f6afcaf90 None admin] PATH_INFO: `/v3/projects/b4fbe9b579bd464ba4d132d4171e9c48` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:45.380356 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486d70c-dfaa-4d9a-9bfb-c03f6afcaf90 None admin] RBAC: Authorizing `identity:get_project(project_id=b4fbe9b579bd464ba4d132d4171e9c48)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:45.381868 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486d70c-dfaa-4d9a-9bfb-c03f6afcaf90 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:45.384023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 48/96] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:46:45 2022] GET /identity/v3/projects/b4fbe9b579bd464ba4d132d4171e9c48 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:46:45.390269 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627c351-c162-47f6-8ade-4ec8eb77fc7c None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:45.517099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627c351-c162-47f6-8ade-4ec8eb77fc7c None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:45.560426 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ace69a-f39d-465c-bab7-21a47b3fdb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:45.561116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ace69a-f39d-465c-bab7-21a47b3fdb40 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:45.561388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ace69a-f39d-465c-bab7-21a47b3fdb40 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:45.561652 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ace69a-f39d-465c-bab7-21a47b3fdb40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:45.562527 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ace69a-f39d-465c-bab7-21a47b3fdb40 None admin] RBAC: Adding query filter params (role.id=9e77c7f209fd4468bcf1b89bfef3c236, scope.project.id=b4fbe9b579bd464ba4d132d4171e9c48, user.id=73fc2af7c3ea4c41af7c840384744887) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:45.562837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ace69a-f39d-465c-bab7-21a47b3fdb40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:45.564292 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ace69a-f39d-465c-bab7-21a47b3fdb40 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:45.575688 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 49/97] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:46:45 2022] GET /identity/v3/role_assignments?user.id=73fc2af7c3ea4c41af7c840384744887&scope.project.id=b4fbe9b579bd464ba4d132d4171e9c48&role.id=9e77c7f209fd4468bcf1b89bfef3c236 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:47.267652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c77aa-c0ea-4290-8f2e-93ae6d669fb1 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:47.268660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c77aa-c0ea-4290-8f2e-93ae6d669fb1 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:47.269150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c77aa-c0ea-4290-8f2e-93ae6d669fb1 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:47.270761 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 49/98] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:47.276182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c4256-c1f9-40b8-b842-e3c768ce6aaa None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:47.276571 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c4256-c1f9-40b8-b842-e3c768ce6aaa None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:47.276747 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c4256-c1f9-40b8-b842-e3c768ce6aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:47.303198 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-8e9c4256-c1f9-40b8-b842-e3c768ce6aaa None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:47.304379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-8e9c4256-c1f9-40b8-b842-e3c768ce6aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:47.391242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 50/99] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:47.426042 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c77aa-c0ea-4290-8f2e-93ae6d669fb1 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:47.546517 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c77aa-c0ea-4290-8f2e-93ae6d669fb1 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:47.589212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80436771-bfbc-4a1a-9f35-ca90ebf980f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:47.590465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80436771-bfbc-4a1a-9f35-ca90ebf980f8 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:47.590936 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80436771-bfbc-4a1a-9f35-ca90ebf980f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:47.591396 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80436771-bfbc-4a1a-9f35-ca90ebf980f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:47.609507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80436771-bfbc-4a1a-9f35-ca90ebf980f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:47.617842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-80436771-bfbc-4a1a-9f35-ca90ebf980f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:46:47.617842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:47.617842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:47.617842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:47.617842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:47.617842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:47.617842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:47.617842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:47.617842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:47.617842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:47.617842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:47.617842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:47.617842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:47.617842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:47.617842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:47.617842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:47.618697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:47.618697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:47.618697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:47.618697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:47.618697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:47.618697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:47.618697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:47.618697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:47.618697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:47.618697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:47.618697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:47.618697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:46:47.618697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:47.618697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:47.618697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:47.618697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:47.619464 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:47.619464 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:47.619464 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:47.619464 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:47.619464 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:47.619464 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:47.619464 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:47.619464 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:47.619464 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:47.619464 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:47.619464 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:46:47.619464 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:46:47.619464 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 50/100] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:46:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:46:47.630973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c4256-c1f9-40b8-b842-e3c768ce6aaa None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:47.758267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c4256-c1f9-40b8-b842-e3c768ce6aaa None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:47.792317 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355f39b-fbb3-40ca-b039-75db8862e5e0 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:47.792661 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355f39b-fbb3-40ca-b039-75db8862e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:47.792870 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355f39b-fbb3-40ca-b039-75db8862e5e0 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:47.794386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 51/101] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:46:47.800447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828d2e5-d251-4431-9d74-24d53e10bcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:47.801076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828d2e5-d251-4431-9d74-24d53e10bcd5 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:47.801356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828d2e5-d251-4431-9d74-24d53e10bcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:47.801626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828d2e5-d251-4431-9d74-24d53e10bcd5 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:47.802407 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828d2e5-d251-4431-9d74-24d53e10bcd5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:47.802711 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828d2e5-d251-4431-9d74-24d53e10bcd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:47.804115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828d2e5-d251-4431-9d74-24d53e10bcd5 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:47.807438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4b93c-1fa3-43c5-91f9-480a105f9e7f None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:47.807727 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4b93c-1fa3-43c5-91f9-480a105f9e7f None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:47.808003 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4b93c-1fa3-43c5-91f9-480a105f9e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:47.816384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 51/102] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:46:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:47.822844 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828d2e5-d251-4431-9d74-24d53e10bcd5 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:47.846439 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-36b4b93c-1fa3-43c5-91f9-480a105f9e7f None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:47.847666 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-36b4b93c-1fa3-43c5-91f9-480a105f9e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:47.921982 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828d2e5-d251-4431-9d74-24d53e10bcd5 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:47.948140 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 52/103] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 03 09:46:47.964673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fe5f8-6065-4184-a0fc-07bebfe03a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:47.965571 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fe5f8-6065-4184-a0fc-07bebfe03a4a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:47.965881 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fe5f8-6065-4184-a0fc-07bebfe03a4a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:47.966162 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fe5f8-6065-4184-a0fc-07bebfe03a4a None admin] PATH_INFO: `/v3/users/73fc2af7c3ea4c41af7c840384744887` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:47.970530 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fe5f8-6065-4184-a0fc-07bebfe03a4a None admin] RBAC: Authorizing `identity:get_user(user_id=73fc2af7c3ea4c41af7c840384744887)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:47.971992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fe5f8-6065-4184-a0fc-07bebfe03a4a None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:47.973656 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 52/104] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:47 2022] GET /identity/v3/users/73fc2af7c3ea4c41af7c840384744887 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:47.979718 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4b93c-1fa3-43c5-91f9-480a105f9e7f None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:47.982555 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fe5f8-6065-4184-a0fc-07bebfe03a4a None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:48.085239 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fe5f8-6065-4184-a0fc-07bebfe03a4a None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:48.130258 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4e14e-e7bb-4923-8146-a870827bfc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:48.131071 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4e14e-e7bb-4923-8146-a870827bfc4a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:48.131353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4e14e-e7bb-4923-8146-a870827bfc4a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:48.131626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4e14e-e7bb-4923-8146-a870827bfc4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:48.145860 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4b93c-1fa3-43c5-91f9-480a105f9e7f None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:48.151941 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4e14e-e7bb-4923-8146-a870827bfc4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:48.159768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-a6f4e14e-e7bb-4923-8146-a870827bfc4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:46:48.159768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:48.159768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:48.159768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:48.159768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:48.159768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:48.159768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:48.159768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:48.159768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:48.159768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:48.159768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:48.159768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:48.159768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:48.159768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:48.159768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:48.159768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:48.161724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:48.161724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:48.161724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:48.161724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:48.161724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:48.161724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:48.161724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:48.161724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:48.161724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:48.161724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:48.161724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:48.161724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:46:48.161724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:48.161724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:48.161724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:48.161724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:48.163660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:48.163660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:48.163660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:48.163660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:48.163660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:48.163660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:48.163660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:48.163660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:48.163660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:48.163660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:48.163660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:46:48.163660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:46:48.163660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 53/105] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:46:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:46:48.173561 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4e14e-e7bb-4923-8146-a870827bfc4a None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:48.229568 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6a390-eb1d-40aa-980d-3a8158f4972a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:48.230482 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6a390-eb1d-40aa-980d-3a8158f4972a None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:48.230762 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6a390-eb1d-40aa-980d-3a8158f4972a None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:48.231036 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6a390-eb1d-40aa-980d-3a8158f4972a None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:48.233065 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6a390-eb1d-40aa-980d-3a8158f4972a None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:48.234576 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6a390-eb1d-40aa-980d-3a8158f4972a None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:48.245045 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 53/106] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:46:47 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:48.259929 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6a390-eb1d-40aa-980d-3a8158f4972a None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:48.381779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4e14e-e7bb-4923-8146-a870827bfc4a None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:48.404450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6a390-eb1d-40aa-980d-3a8158f4972a None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:48.446704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea27d3-6a40-480c-bf49-74437b3aaada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:48.449268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea27d3-6a40-480c-bf49-74437b3aaada None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:48.449560 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea27d3-6a40-480c-bf49-74437b3aaada None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:48.450205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea27d3-6a40-480c-bf49-74437b3aaada None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e/users/73fc2af7c3ea4c41af7c840384744887/roles/9e77c7f209fd4468bcf1b89bfef3c236` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:48.454474 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea27d3-6a40-480c-bf49-74437b3aaada None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb6e6402b314d21a8beef0b41fcae2e, user_id=73fc2af7c3ea4c41af7c840384744887, role_id=9e77c7f209fd4468bcf1b89bfef3c236)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:48.455940 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea27d3-6a40-480c-bf49-74437b3aaada None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:48.462720 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bce33e-8d4c-43fc-b98e-2024d039e0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:48.463403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bce33e-8d4c-43fc-b98e-2024d039e0c5 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:48.463689 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bce33e-8d4c-43fc-b98e-2024d039e0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:48.464028 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bce33e-8d4c-43fc-b98e-2024d039e0c5 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:48.464788 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bce33e-8d4c-43fc-b98e-2024d039e0c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:48.465097 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bce33e-8d4c-43fc-b98e-2024d039e0c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:48.467344 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bce33e-8d4c-43fc-b98e-2024d039e0c5 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:48.485672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 54/107] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:46:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:48.492276 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 54/108] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:46:48 2022] PUT /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e/users/73fc2af7c3ea4c41af7c840384744887/roles/9e77c7f209fd4468bcf1b89bfef3c236 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:46:48.494319 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bce33e-8d4c-43fc-b98e-2024d039e0c5 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:48.526892 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8843c68-c7e1-42e7-83b3-6efc5c728526 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:48.527522 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8843c68-c7e1-42e7-83b3-6efc5c728526 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:48.527993 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8843c68-c7e1-42e7-83b3-6efc5c728526 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:48.529730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 55/109] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:46:48.535854 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dc590-0564-43a4-811d-a10dc18440f2 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:48.536461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dc590-0564-43a4-811d-a10dc18440f2 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:48.536932 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dc590-0564-43a4-811d-a10dc18440f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:48.575033 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-607dc590-0564-43a4-811d-a10dc18440f2 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:48.576759 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-607dc590-0564-43a4-811d-a10dc18440f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:48.682067 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bce33e-8d4c-43fc-b98e-2024d039e0c5 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:48.705419 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 56/110] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:46:48.707046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69169e02-4e1a-4ed2-8143-b4c92d36d33c None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:48.708344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69169e02-4e1a-4ed2-8143-b4c92d36d33c None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:48.708791 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69169e02-4e1a-4ed2-8143-b4c92d36d33c None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:48.710340 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 57/111] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:48.718307 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8da8d1-31ba-4a3a-8c3e-8c4694cc7938 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:48.718808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8da8d1-31ba-4a3a-8c3e-8c4694cc7938 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:48.719214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8da8d1-31ba-4a3a-8c3e-8c4694cc7938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:48.739822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-1d8da8d1-31ba-4a3a-8c3e-8c4694cc7938 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:48.741463 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-1d8da8d1-31ba-4a3a-8c3e-8c4694cc7938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:48.741689 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd07b62-b626-4f9f-a2b4-2be250416f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:48.742635 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd07b62-b626-4f9f-a2b4-2be250416f4a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:48.742979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd07b62-b626-4f9f-a2b4-2be250416f4a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:48.743417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd07b62-b626-4f9f-a2b4-2be250416f4a None admin] PATH_INFO: `/v3/users/3409da654b054b979d2c52a756bb7ee6` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:48.744831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd07b62-b626-4f9f-a2b4-2be250416f4a None admin] RBAC: Authorizing `identity:get_user(user_id=3409da654b054b979d2c52a756bb7ee6)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:48.749371 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd07b62-b626-4f9f-a2b4-2be250416f4a None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:48.751305 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 55/112] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:48 2022] GET /identity/v3/users/3409da654b054b979d2c52a756bb7ee6 => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:48.753736 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd07b62-b626-4f9f-a2b4-2be250416f4a None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:48.817406 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 58/113] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:46:48.818405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8da8d1-31ba-4a3a-8c3e-8c4694cc7938 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:48.879416 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd07b62-b626-4f9f-a2b4-2be250416f4a None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:48.920407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8da8d1-31ba-4a3a-8c3e-8c4694cc7938 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:48.921341 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d52a52-a064-4112-8774-67d04bc3efd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:48.923332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d52a52-a064-4112-8774-67d04bc3efd6 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:48.923811 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d52a52-a064-4112-8774-67d04bc3efd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:48.924286 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d52a52-a064-4112-8774-67d04bc3efd6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:48.939324 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d52a52-a064-4112-8774-67d04bc3efd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:48.949207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-e5d52a52-a064-4112-8774-67d04bc3efd6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:46:48.949207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:48.949207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:48.949207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:48.949207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:48.949207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:48.949207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:48.949207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:48.949207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:48.949207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:48.949207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:48.949207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:48.949207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:48.949207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:48.949207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:48.949207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:48.950385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:48.950385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:48.950385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:48.950385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:48.950385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:48.950385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:48.950385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:48.950385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:48.950385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:48.950385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:48.950385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:48.950385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:46:48.950385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:48.950385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:48.950385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:48.950385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:48.951203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:48.951203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:48.951203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:48.951203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:48.951203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:48.951203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:48.951203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:48.951203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:48.951203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:48.951203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:48.951203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:46:48.951203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:46:48.951836 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 56/114] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:46:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:46:48.952657 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d52a52-a064-4112-8774-67d04bc3efd6 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:48.959102 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2944b-0130-492d-88ea-d252b973ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:48.960243 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2944b-0130-492d-88ea-d252b973ff00 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:48.960735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2944b-0130-492d-88ea-d252b973ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:48.961186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2944b-0130-492d-88ea-d252b973ff00 None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:48.962752 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2944b-0130-492d-88ea-d252b973ff00 None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:48.964424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2944b-0130-492d-88ea-d252b973ff00 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:48.966738 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 59/115] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:46:48 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:48.967803 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2944b-0130-492d-88ea-d252b973ff00 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:49.071021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2944b-0130-492d-88ea-d252b973ff00 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:49.079126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d52a52-a064-4112-8774-67d04bc3efd6 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:49.105189 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df2fb5-6c09-4ede-85c7-98bd9d74c984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:49.106249 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df2fb5-6c09-4ede-85c7-98bd9d74c984 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:49.106749 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df2fb5-6c09-4ede-85c7-98bd9d74c984 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:49.107240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df2fb5-6c09-4ede-85c7-98bd9d74c984 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:49.108191 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df2fb5-6c09-4ede-85c7-98bd9d74c984 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:49.108734 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df2fb5-6c09-4ede-85c7-98bd9d74c984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:49.110386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df2fb5-6c09-4ede-85c7-98bd9d74c984 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:49.117555 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603188e-648c-4b08-88ca-1524014330ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:49.118440 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603188e-648c-4b08-88ca-1524014330ae None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:49.118721 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603188e-648c-4b08-88ca-1524014330ae None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:49.118993 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603188e-648c-4b08-88ca-1524014330ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:49.120012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 60/116] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:46:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:49.120212 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603188e-648c-4b08-88ca-1524014330ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:49.121307 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df2fb5-6c09-4ede-85c7-98bd9d74c984 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:49.121617 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603188e-648c-4b08-88ca-1524014330ae None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:49.123282 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 57/117] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:46:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:49.128471 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603188e-648c-4b08-88ca-1524014330ae None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:49.224877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df2fb5-6c09-4ede-85c7-98bd9d74c984 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:49.251093 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603188e-648c-4b08-88ca-1524014330ae None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:49.262823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22464e93-3393-444a-99cd-73f21ab7303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:49.263804 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22464e93-3393-444a-99cd-73f21ab7303c None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:49.264089 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22464e93-3393-444a-99cd-73f21ab7303c None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:49.264364 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22464e93-3393-444a-99cd-73f21ab7303c None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e/users/3409da654b054b979d2c52a756bb7ee6/roles/52d3ad3e32c741938997691c9a909b81` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:49.266328 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22464e93-3393-444a-99cd-73f21ab7303c None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb6e6402b314d21a8beef0b41fcae2e, user_id=3409da654b054b979d2c52a756bb7ee6, role_id=52d3ad3e32c741938997691c9a909b81)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:49.267787 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22464e93-3393-444a-99cd-73f21ab7303c None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:49.289829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 61/118] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:46:49 2022] PUT /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e/users/3409da654b054b979d2c52a756bb7ee6/roles/52d3ad3e32c741938997691c9a909b81 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:46:49.289829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22464e93-3393-444a-99cd-73f21ab7303c None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:49.297463 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07f77c-8d83-43bd-9178-519a3dbd8a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:49.298427 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07f77c-8d83-43bd-9178-519a3dbd8a9f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:49.298712 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07f77c-8d83-43bd-9178-519a3dbd8a9f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:49.298990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07f77c-8d83-43bd-9178-519a3dbd8a9f None admin] PATH_INFO: `/v3/users/19fe19561183438eb6b5c3d8e14b53c3` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:49.314703 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07f77c-8d83-43bd-9178-519a3dbd8a9f None admin] RBAC: Authorizing `identity:get_user(user_id=19fe19561183438eb6b5c3d8e14b53c3)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:49.316225 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07f77c-8d83-43bd-9178-519a3dbd8a9f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:49.318205 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 58/119] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:49 2022] GET /identity/v3/users/19fe19561183438eb6b5c3d8e14b53c3 => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:49.319648 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead516-6b67-47ad-9108-53a54291ecf3 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:49.319936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead516-6b67-47ad-9108-53a54291ecf3 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:49.320212 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead516-6b67-47ad-9108-53a54291ecf3 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:49.321621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 59/120] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:49.322941 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d56a9-d24d-4981-a8b4-587cd230ce5e None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:49.323312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d56a9-d24d-4981-a8b4-587cd230ce5e None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:49.323591 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d56a9-d24d-4981-a8b4-587cd230ce5e None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:49.324960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 60/121] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:49.330793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5a87b-a8d0-4ec2-82ee-624663e72352 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:49.331149 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5a87b-a8d0-4ec2-82ee-624663e72352 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:49.331495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5a87b-a8d0-4ec2-82ee-624663e72352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:49.349566 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-baf5a87b-a8d0-4ec2-82ee-624663e72352 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:49.351195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-baf5a87b-a8d0-4ec2-82ee-624663e72352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:49.417084 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22464e93-3393-444a-99cd-73f21ab7303c None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:49.421092 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 61/122] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:49.422067 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5a87b-a8d0-4ec2-82ee-624663e72352 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:49.461698 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd933a-3b6d-4877-bc75-5e73796083e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:49.462425 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd933a-3b6d-4877-bc75-5e73796083e9 None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:49.462838 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd933a-3b6d-4877-bc75-5e73796083e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:49.463161 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd933a-3b6d-4877-bc75-5e73796083e9 None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:49.463888 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd933a-3b6d-4877-bc75-5e73796083e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:49.465360 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd933a-3b6d-4877-bc75-5e73796083e9 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:49.509898 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 62/123] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 3 09:46:49 2022] POST /identity/v3/projects => generated 302 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:46:49.510409 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c08cb8-3849-4d27-a2f5-7672d083e43a None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:49.510706 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c08cb8-3849-4d27-a2f5-7672d083e43a None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:49.510983 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c08cb8-3849-4d27-a2f5-7672d083e43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:49.531962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-74c08cb8-3849-4d27-a2f5-7672d083e43a None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:49.533863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-74c08cb8-3849-4d27-a2f5-7672d083e43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:49.546466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5a87b-a8d0-4ec2-82ee-624663e72352 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:49.583760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328f794-0aa4-4947-b427-7b03363110ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:49.584475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328f794-0aa4-4947-b427-7b03363110ad None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:49.584789 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328f794-0aa4-4947-b427-7b03363110ad None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:49.585068 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328f794-0aa4-4947-b427-7b03363110ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:49.609544 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 63/124] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:49.610468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c08cb8-3849-4d27-a2f5-7672d083e43a None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:49.658109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328f794-0aa4-4947-b427-7b03363110ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:49.659607 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328f794-0aa4-4947-b427-7b03363110ad None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:49.713926 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c08cb8-3849-4d27-a2f5-7672d083e43a None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:49.749967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71057823-78d7-4ef2-b34e-a66bb7a0053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:49.750780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71057823-78d7-4ef2-b34e-a66bb7a0053a None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:49.751062 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71057823-78d7-4ef2-b34e-a66bb7a0053a None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:49.751331 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71057823-78d7-4ef2-b34e-a66bb7a0053a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:49.762932 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71057823-78d7-4ef2-b34e-a66bb7a0053a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:49.764946 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 62/125] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:46:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:46:49.766147 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328f794-0aa4-4947-b427-7b03363110ad None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:49.779539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-71057823-78d7-4ef2-b34e-a66bb7a0053a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:46:49.779539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:49.779539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:49.779539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:49.779539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:49.779539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:49.779539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:49.779539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:49.779539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:49.779539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:49.779539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:49.779539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:49.779539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:49.779539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:49.779539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:49.779539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:49.780434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:49.780434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:49.780434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:49.780434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:49.780434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:49.780434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:49.780434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:49.780434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:49.780434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:49.780434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:49.780434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:49.780434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:46:49.780434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:49.780434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:49.780434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:49.780434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:49.785070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:49.785070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:49.785070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:49.785070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:49.785070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:49.785070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:49.785070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:49.785070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:49.785070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:49.785070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:49.785070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:46:49.785070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:46:49.785070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 64/126] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:46:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:46:49.785070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71057823-78d7-4ef2-b34e-a66bb7a0053a None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:49.886824 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328f794-0aa4-4947-b427-7b03363110ad None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:49.888105 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71057823-78d7-4ef2-b34e-a66bb7a0053a None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:49.925897 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b04d0-9474-4dc4-8c1a-976636fbe124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:49.925897 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b04d0-9474-4dc4-8c1a-976636fbe124 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:49.925897 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b04d0-9474-4dc4-8c1a-976636fbe124 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:49.925897 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b04d0-9474-4dc4-8c1a-976636fbe124 None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:49.926313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b04d0-9474-4dc4-8c1a-976636fbe124 None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:49.926566 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b04d0-9474-4dc4-8c1a-976636fbe124 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:49.927931 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562e305-acb4-49e8-8f41-95310cb021f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:49.928644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 65/127] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:46:49 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:49.928975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562e305-acb4-49e8-8f41-95310cb021f3 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:49.929418 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b04d0-9474-4dc4-8c1a-976636fbe124 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:49.929543 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562e305-acb4-49e8-8f41-95310cb021f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:49.930015 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562e305-acb4-49e8-8f41-95310cb021f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:49.954702 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562e305-acb4-49e8-8f41-95310cb021f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:49.963029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-1562e305-acb4-49e8-8f41-95310cb021f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:46:49.963029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:49.963029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:49.963029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:49.963029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:49.963029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:49.963029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:49.963029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:49.963029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:49.963029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:49.963029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:49.963029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:49.963029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:49.963029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:49.963029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:49.963029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:49.963877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:49.963877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:49.963877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:49.963877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:49.963877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:49.963877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:49.963877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:49.963877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:49.963877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:49.963877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:49.963877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:49.963877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:46:49.963877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:49.963877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:49.963877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:49.963877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:49.964666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:49.964666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:49.964666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:49.964666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:49.964666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:49.964666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:49.964666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:49.964666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:49.964666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:49.964666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:49.964666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:46:49.964666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:46:49.971009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 63/128] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:46:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:46:49.971876 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562e305-acb4-49e8-8f41-95310cb021f3 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:50.025886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b04d0-9474-4dc4-8c1a-976636fbe124 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:50.062102 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088a95f-db7d-455f-b598-db683d7a7beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:50.062771 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088a95f-db7d-455f-b598-db683d7a7beb None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:50.063050 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088a95f-db7d-455f-b598-db683d7a7beb None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:50.063320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088a95f-db7d-455f-b598-db683d7a7beb None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:50.064065 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088a95f-db7d-455f-b598-db683d7a7beb None admin] RBAC: Adding query filter params (name=member) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:50.064364 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088a95f-db7d-455f-b598-db683d7a7beb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:50.065739 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088a95f-db7d-455f-b598-db683d7a7beb None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:50.084676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 66/129] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:46:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:50.085568 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088a95f-db7d-455f-b598-db683d7a7beb None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:50.173670 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562e305-acb4-49e8-8f41-95310cb021f3 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:50.216217 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003d8da-a505-4d29-8ee6-f4d7dcba603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:50.216887 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003d8da-a505-4d29-8ee6-f4d7dcba603e None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:50.217174 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003d8da-a505-4d29-8ee6-f4d7dcba603e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:50.217504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003d8da-a505-4d29-8ee6-f4d7dcba603e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:50.218391 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003d8da-a505-4d29-8ee6-f4d7dcba603e None admin] RBAC: Adding query filter params (role.id=2f97989a57b241f18734bf5df7ebe048, scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e, user.id=19fe19561183438eb6b5c3d8e14b53c3) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:50.218758 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003d8da-a505-4d29-8ee6-f4d7dcba603e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:50.221229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003d8da-a505-4d29-8ee6-f4d7dcba603e None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:50.235459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 64/130] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:46:49 2022] GET /identity/v3/role_assignments?user.id=19fe19561183438eb6b5c3d8e14b53c3&scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e&role.id=2f97989a57b241f18734bf5df7ebe048 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:50.235459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003d8da-a505-4d29-8ee6-f4d7dcba603e None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:50.255566 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088a95f-db7d-455f-b598-db683d7a7beb None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:50.339479 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee24065-b035-4f21-8efc-2497819f9fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:50.340169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee24065-b035-4f21-8efc-2497819f9fa3 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:50.340453 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee24065-b035-4f21-8efc-2497819f9fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:50.340727 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee24065-b035-4f21-8efc-2497819f9fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:50.341493 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee24065-b035-4f21-8efc-2497819f9fa3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:50.341819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee24065-b035-4f21-8efc-2497819f9fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:50.343228 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee24065-b035-4f21-8efc-2497819f9fa3 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:50.372545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 67/131] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:46:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:50.378167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee24065-b035-4f21-8efc-2497819f9fa3 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:50.441230 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003d8da-a505-4d29-8ee6-f4d7dcba603e None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:50.533683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1e72c-ff2d-4250-92e9-f6f87f0a07a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:50.534974 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1e72c-ff2d-4250-92e9-f6f87f0a07a3 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:50.535450 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1e72c-ff2d-4250-92e9-f6f87f0a07a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:50.535932 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1e72c-ff2d-4250-92e9-f6f87f0a07a3 None admin] PATH_INFO: `/v3/users/73fc2af7c3ea4c41af7c840384744887` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:50.542658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1e72c-ff2d-4250-92e9-f6f87f0a07a3 None admin] RBAC: Authorizing `identity:get_user(user_id=73fc2af7c3ea4c41af7c840384744887)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:50.544407 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1e72c-ff2d-4250-92e9-f6f87f0a07a3 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:50.546345 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 65/132] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:50 2022] GET /identity/v3/users/73fc2af7c3ea4c41af7c840384744887 => generated 275 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:50.553809 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1e72c-ff2d-4250-92e9-f6f87f0a07a3 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:50.569848 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee24065-b035-4f21-8efc-2497819f9fa3 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:50.607443 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dc2ee-fdbd-49ee-b774-d5c4264bda87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:50.608343 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dc2ee-fdbd-49ee-b774-d5c4264bda87 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:50.608625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dc2ee-fdbd-49ee-b774-d5c4264bda87 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:50.608906 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dc2ee-fdbd-49ee-b774-d5c4264bda87 None admin] PATH_INFO: `/v3/users/73fc2af7c3ea4c41af7c840384744887` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:50.610222 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304dc2ee-fdbd-49ee-b774-d5c4264bda87 None admin] RBAC: Authorizing `identity:get_user(user_id=73fc2af7c3ea4c41af7c840384744887)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:50.611990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304dc2ee-fdbd-49ee-b774-d5c4264bda87 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:50.615455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 68/133] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:50 2022] GET /identity/v3/users/73fc2af7c3ea4c41af7c840384744887 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:46:50.622637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dc2ee-fdbd-49ee-b774-d5c4264bda87 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:50.735521 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1e72c-ff2d-4250-92e9-f6f87f0a07a3 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:50.747913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dc2ee-fdbd-49ee-b774-d5c4264bda87 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:50.785498 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfb43d-0197-4a65-bc06-b8a3c4e610ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:50.786402 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfb43d-0197-4a65-bc06-b8a3c4e610ee None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:50.786686 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfb43d-0197-4a65-bc06-b8a3c4e610ee None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:50.786961 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfb43d-0197-4a65-bc06-b8a3c4e610ee None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:50.788285 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfb43d-0197-4a65-bc06-b8a3c4e610ee None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:50.791142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfb43d-0197-4a65-bc06-b8a3c4e610ee None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:50.798819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 69/134] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:46:50 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:50.803401 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfb43d-0197-4a65-bc06-b8a3c4e610ee None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:50.816753 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1953bba-e195-4e28-b561-f2daa28a72ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:50.817644 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1953bba-e195-4e28-b561-f2daa28a72ac None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:50.817988 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1953bba-e195-4e28-b561-f2daa28a72ac None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:50.818268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1953bba-e195-4e28-b561-f2daa28a72ac None admin] PATH_INFO: `/v3/projects/b4fbe9b579bd464ba4d132d4171e9c48` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:50.819471 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1953bba-e195-4e28-b561-f2daa28a72ac None admin] RBAC: Authorizing `identity:get_project(project_id=b4fbe9b579bd464ba4d132d4171e9c48)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:50.821171 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1953bba-e195-4e28-b561-f2daa28a72ac None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:50.827639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 66/135] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:46:50 2022] GET /identity/v3/projects/b4fbe9b579bd464ba4d132d4171e9c48 => generated 312 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:50.847353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1953bba-e195-4e28-b561-f2daa28a72ac None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:50.982568 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfb43d-0197-4a65-bc06-b8a3c4e610ee None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:51.033225 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de5ca6-7019-4012-853a-847cd9d674ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:51.034204 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de5ca6-7019-4012-853a-847cd9d674ab None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:51.034496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de5ca6-7019-4012-853a-847cd9d674ab None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:51.034759 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de5ca6-7019-4012-853a-847cd9d674ab None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e/users/73fc2af7c3ea4c41af7c840384744887/roles/cb8032f764644c90a3dc0cb396434d67` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:51.036967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de5ca6-7019-4012-853a-847cd9d674ab None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb6e6402b314d21a8beef0b41fcae2e, user_id=73fc2af7c3ea4c41af7c840384744887, role_id=cb8032f764644c90a3dc0cb396434d67)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:51.038471 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de5ca6-7019-4012-853a-847cd9d674ab None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:51.062477 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 70/136] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:46:50 2022] PUT /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e/users/73fc2af7c3ea4c41af7c840384744887/roles/cb8032f764644c90a3dc0cb396434d67 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:46:51.065954 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1953bba-e195-4e28-b561-f2daa28a72ac None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:51.131064 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526e0be-3d19-4f39-9ebd-7a94dbe7bb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:51.131976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526e0be-3d19-4f39-9ebd-7a94dbe7bb3f None admin] REQUEST_METHOD: `PUT` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:51.132261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526e0be-3d19-4f39-9ebd-7a94dbe7bb3f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:51.132849 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526e0be-3d19-4f39-9ebd-7a94dbe7bb3f None admin] PATH_INFO: `/v3/projects/b4fbe9b579bd464ba4d132d4171e9c48/users/73fc2af7c3ea4c41af7c840384744887/roles/9e77c7f209fd4468bcf1b89bfef3c236` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:51.136593 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526e0be-3d19-4f39-9ebd-7a94dbe7bb3f None admin] RBAC: Authorizing `identity:create_grant(project_id=b4fbe9b579bd464ba4d132d4171e9c48, user_id=73fc2af7c3ea4c41af7c840384744887, role_id=9e77c7f209fd4468bcf1b89bfef3c236)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:51.138220 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526e0be-3d19-4f39-9ebd-7a94dbe7bb3f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:51.164703 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 67/137] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:46:50 2022] PUT /identity/v3/projects/b4fbe9b579bd464ba4d132d4171e9c48/users/73fc2af7c3ea4c41af7c840384744887/roles/9e77c7f209fd4468bcf1b89bfef3c236 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:46:51.796279 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbc8ce-143b-4867-8776-ba1a65fdaee2 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:51.796788 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbc8ce-143b-4867-8776-ba1a65fdaee2 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:51.796890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbc8ce-143b-4867-8776-ba1a65fdaee2 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:51.798219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 71/138] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:51.803578 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b642b-4349-4d20-a4bc-55b4950f4d6b None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:51.804013 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b642b-4349-4d20-a4bc-55b4950f4d6b None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:51.804205 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b642b-4349-4d20-a4bc-55b4950f4d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:51.827603 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-9f2b642b-4349-4d20-a4bc-55b4950f4d6b None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:51.828785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-9f2b642b-4349-4d20-a4bc-55b4950f4d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:51.910988 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 68/139] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:51.945226 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbc8ce-143b-4867-8776-ba1a65fdaee2 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:52.063470 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbc8ce-143b-4867-8776-ba1a65fdaee2 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:52.105438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad14d41-8ec5-42c2-b8ea-dcfa9b360da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:52.106284 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad14d41-8ec5-42c2-b8ea-dcfa9b360da3 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:52.106562 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad14d41-8ec5-42c2-b8ea-dcfa9b360da3 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:52.106831 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad14d41-8ec5-42c2-b8ea-dcfa9b360da3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:52.117257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad14d41-8ec5-42c2-b8ea-dcfa9b360da3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:52.129160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-bad14d41-8ec5-42c2-b8ea-dcfa9b360da3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:46:52.129160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:52.129160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:52.129160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:52.129160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:52.129160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:52.129160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:52.129160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:52.129160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:52.129160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:52.129160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:52.129160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:52.129160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:52.129160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:52.129160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:52.129160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:52.130109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:52.130109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:52.130109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:52.130109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:52.130109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:52.130109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:52.130109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:52.130109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:52.130109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:52.130109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:52.130109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:52.130109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:46:52.130109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:52.130109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:52.130109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:52.130109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:52.130871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:52.130871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:52.130871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:52.130871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:52.130871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:52.130871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:52.130871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:52.130871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:52.130871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:52.130871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:52.130871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:46:52.130871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:46:52.130871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 72/140] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:46:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:46:52.137459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b642b-4349-4d20-a4bc-55b4950f4d6b None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:52.305367 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b642b-4349-4d20-a4bc-55b4950f4d6b None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:52.351850 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22616acf-6307-48e1-b277-52e7e8228e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:52.353376 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22616acf-6307-48e1-b277-52e7e8228e3a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:52.353888 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22616acf-6307-48e1-b277-52e7e8228e3a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:52.354356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22616acf-6307-48e1-b277-52e7e8228e3a None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:52.355303 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22616acf-6307-48e1-b277-52e7e8228e3a None admin] RBAC: Adding query filter params (name=member) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:52.355797 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22616acf-6307-48e1-b277-52e7e8228e3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:52.357394 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22616acf-6307-48e1-b277-52e7e8228e3a None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:52.370085 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 69/141] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:46:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:52.380855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad14d41-8ec5-42c2-b8ea-dcfa9b360da3 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:52.509636 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad14d41-8ec5-42c2-b8ea-dcfa9b360da3 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:52.553483 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be230fa4-5611-401a-a1c2-b214bdabf62a None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:52.554134 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be230fa4-5611-401a-a1c2-b214bdabf62a None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:52.554622 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be230fa4-5611-401a-a1c2-b214bdabf62a None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:52.556391 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 70/142] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:46:52.560389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba2a82-17b7-49b2-b764-a3baa06ea6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:52.561518 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba2a82-17b7-49b2-b764-a3baa06ea6a5 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:52.562020 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba2a82-17b7-49b2-b764-a3baa06ea6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:52.562506 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba2a82-17b7-49b2-b764-a3baa06ea6a5 None admin] PATH_INFO: `/v3/users/73fc2af7c3ea4c41af7c840384744887` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:52.563893 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba2a82-17b7-49b2-b764-a3baa06ea6a5 None admin] RBAC: Authorizing `identity:get_user(user_id=73fc2af7c3ea4c41af7c840384744887)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:52.565532 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba2a82-17b7-49b2-b764-a3baa06ea6a5 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:52.567641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 73/143] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:52 2022] GET /identity/v3/users/73fc2af7c3ea4c41af7c840384744887 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:52.571967 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab62b8a-bc41-4b6f-8545-d18045a7e15b None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:52.572495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab62b8a-bc41-4b6f-8545-d18045a7e15b None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:52.572959 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab62b8a-bc41-4b6f-8545-d18045a7e15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:52.579021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba2a82-17b7-49b2-b764-a3baa06ea6a5 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:52.591253 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-6ab62b8a-bc41-4b6f-8545-d18045a7e15b None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:52.592732 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-6ab62b8a-bc41-4b6f-8545-d18045a7e15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:52.660051 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 71/144] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:46:52.661694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e198b90-cf49-4565-a6ab-a2afda026575 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:52.662096 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e198b90-cf49-4565-a6ab-a2afda026575 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:52.666188 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e198b90-cf49-4565-a6ab-a2afda026575 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:52.667661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 72/145] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:52.674340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064a542-64d9-4ffb-a09f-1ee727d88856 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:52.674732 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064a542-64d9-4ffb-a09f-1ee727d88856 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:52.675106 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064a542-64d9-4ffb-a09f-1ee727d88856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:52.697374 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba2a82-17b7-49b2-b764-a3baa06ea6a5 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:52.705298 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-b064a542-64d9-4ffb-a09f-1ee727d88856 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:52.706631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-b064a542-64d9-4ffb-a09f-1ee727d88856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:52.742478 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dc4b5-716f-45fd-8804-0f8938ceb582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:52.743496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dc4b5-716f-45fd-8804-0f8938ceb582 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:52.743921 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dc4b5-716f-45fd-8804-0f8938ceb582 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:52.745640 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dc4b5-716f-45fd-8804-0f8938ceb582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:52.821993 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 73/146] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:46:52.823419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064a542-64d9-4ffb-a09f-1ee727d88856 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:52.893881 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dc4b5-716f-45fd-8804-0f8938ceb582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:52.895951 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dc4b5-716f-45fd-8804-0f8938ceb582 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:52.979987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064a542-64d9-4ffb-a09f-1ee727d88856 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:53.013463 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3875c79-bbdf-4ba0-98a2-9f949df23437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:53.014536 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3875c79-bbdf-4ba0-98a2-9f949df23437 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:53.014978 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3875c79-bbdf-4ba0-98a2-9f949df23437 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:53.015398 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3875c79-bbdf-4ba0-98a2-9f949df23437 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:53.016692 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3875c79-bbdf-4ba0-98a2-9f949df23437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:53.018313 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3875c79-bbdf-4ba0-98a2-9f949df23437 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:53.020076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 74/147] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:46:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:53.021020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3875c79-bbdf-4ba0-98a2-9f949df23437 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:53.093976 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 74/148] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:46:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:46:53.094828 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dc4b5-716f-45fd-8804-0f8938ceb582 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:53.128912 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3875c79-bbdf-4ba0-98a2-9f949df23437 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:53.162844 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37056d20-875c-4e20-8d8e-6956587807cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:53.163980 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37056d20-875c-4e20-8d8e-6956587807cf None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:53.164529 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37056d20-875c-4e20-8d8e-6956587807cf None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:53.165224 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37056d20-875c-4e20-8d8e-6956587807cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:53.176095 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37056d20-875c-4e20-8d8e-6956587807cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:53.184477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-37056d20-875c-4e20-8d8e-6956587807cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:46:53.184477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:53.184477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:53.184477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:53.184477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:53.184477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:53.184477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:53.184477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:53.184477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:53.184477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:53.184477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:53.184477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:53.184477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:53.184477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:53.184477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:53.184477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:53.185351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:53.185351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:53.185351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:53.185351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:53.185351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:53.185351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:53.185351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:53.185351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:53.185351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:53.185351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:53.185351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:53.185351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:46:53.185351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:53.185351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:53.185351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:53.185351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:53.186136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:53.186136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:53.186136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:53.186136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:53.186136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:53.186136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:53.186136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:53.186136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:53.186136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:53.186136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:53.186136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:46:53.186136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:46:53.188779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 75/149] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:46:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:46:53.194715 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37056d20-875c-4e20-8d8e-6956587807cf None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:53.249846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dc4b5-716f-45fd-8804-0f8938ceb582 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:53.293827 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecdee4-90da-426d-a498-04501ca8dafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:53.293827 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecdee4-90da-426d-a498-04501ca8dafa None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:53.293827 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecdee4-90da-426d-a498-04501ca8dafa None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:53.293827 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecdee4-90da-426d-a498-04501ca8dafa None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:53.294201 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecdee4-90da-426d-a498-04501ca8dafa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:53.294201 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecdee4-90da-426d-a498-04501ca8dafa None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:53.330440 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 75/150] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:46:53 2022] POST /identity/v3/users => generated 283 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:46:53.331113 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecdee4-90da-426d-a498-04501ca8dafa None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:53.359891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37056d20-875c-4e20-8d8e-6956587807cf None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:53.401760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0313e57-ab97-41fd-a125-6af4856f5deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:53.402657 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0313e57-ab97-41fd-a125-6af4856f5deb None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:53.402937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0313e57-ab97-41fd-a125-6af4856f5deb None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:53.403205 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0313e57-ab97-41fd-a125-6af4856f5deb None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:53.408572 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0313e57-ab97-41fd-a125-6af4856f5deb None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:53.410067 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0313e57-ab97-41fd-a125-6af4856f5deb None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:53.412073 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 76/151] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:46:53 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:53.432225 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0313e57-ab97-41fd-a125-6af4856f5deb None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:53.544554 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0313e57-ab97-41fd-a125-6af4856f5deb None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:53.572177 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecdee4-90da-426d-a498-04501ca8dafa None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:53.589213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2909b0a-e557-4595-a43f-3e41a5de2397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:53.589904 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2909b0a-e557-4595-a43f-3e41a5de2397 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:53.590181 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2909b0a-e557-4595-a43f-3e41a5de2397 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:53.590450 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2909b0a-e557-4595-a43f-3e41a5de2397 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:53.591290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2909b0a-e557-4595-a43f-3e41a5de2397 None admin] RBAC: Adding query filter params (role.id=9e77c7f209fd4468bcf1b89bfef3c236, scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e, user.id=73fc2af7c3ea4c41af7c840384744887) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:53.591597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2909b0a-e557-4595-a43f-3e41a5de2397 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:53.593055 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2909b0a-e557-4595-a43f-3e41a5de2397 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:53.605964 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 77/152] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:46:53 2022] GET /identity/v3/role_assignments?user.id=73fc2af7c3ea4c41af7c840384744887&scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e&role.id=9e77c7f209fd4468bcf1b89bfef3c236 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:53.633770 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dffe9-b267-4a46-af57-43606c7e404f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:53.634486 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dffe9-b267-4a46-af57-43606c7e404f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:53.634767 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dffe9-b267-4a46-af57-43606c7e404f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:53.635036 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dffe9-b267-4a46-af57-43606c7e404f None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:53.635806 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dffe9-b267-4a46-af57-43606c7e404f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:53.636106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dffe9-b267-4a46-af57-43606c7e404f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:53.637512 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dffe9-b267-4a46-af57-43606c7e404f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:53.652235 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 76/153] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:46:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:53.653313 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2909b0a-e557-4595-a43f-3e41a5de2397 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:53.781702 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2909b0a-e557-4595-a43f-3e41a5de2397 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:53.822560 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc771c-08eb-4015-bc1b-088e1f3fc1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:53.823373 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc771c-08eb-4015-bc1b-088e1f3fc1c2 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:53.823649 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc771c-08eb-4015-bc1b-088e1f3fc1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:53.823918 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc771c-08eb-4015-bc1b-088e1f3fc1c2 None admin] PATH_INFO: `/v3/users/3409da654b054b979d2c52a756bb7ee6` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:53.825172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc771c-08eb-4015-bc1b-088e1f3fc1c2 None admin] RBAC: Authorizing `identity:get_user(user_id=3409da654b054b979d2c52a756bb7ee6)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:53.826641 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc771c-08eb-4015-bc1b-088e1f3fc1c2 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:53.828467 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 78/154] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:53 2022] GET /identity/v3/users/3409da654b054b979d2c52a756bb7ee6 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:53.834081 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dffe9-b267-4a46-af57-43606c7e404f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:53.889004 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bacb62-91c5-430d-b112-3a24e284814e None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:53.889309 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bacb62-91c5-430d-b112-3a24e284814e None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:53.889562 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bacb62-91c5-430d-b112-3a24e284814e None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:53.891454 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 79/155] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:53.903017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb26bc-73f4-4853-bb71-d01e7631ce4c None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:53.903017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb26bc-73f4-4853-bb71-d01e7631ce4c None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:53.903258 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb26bc-73f4-4853-bb71-d01e7631ce4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:53.922710 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-2cfb26bc-73f4-4853-bb71-d01e7631ce4c None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:53.924225 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-2cfb26bc-73f4-4853-bb71-d01e7631ce4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:53.946483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dffe9-b267-4a46-af57-43606c7e404f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:53.985292 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb50767-6b80-459a-af3a-f671f705c804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:53.985978 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb50767-6b80-459a-af3a-f671f705c804 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:53.986254 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb50767-6b80-459a-af3a-f671f705c804 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:53.986519 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb50767-6b80-459a-af3a-f671f705c804 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:54.012568 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 80/156] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:46:54.034634 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb26bc-73f4-4853-bb71-d01e7631ce4c None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:54.064616 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb50767-6b80-459a-af3a-f671f705c804 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:54.066172 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb50767-6b80-459a-af3a-f671f705c804 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:54.158274 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb26bc-73f4-4853-bb71-d01e7631ce4c None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:54.182995 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 77/157] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:46:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:46:54.188975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb50767-6b80-459a-af3a-f671f705c804 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:54.206216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc789d-0fec-41eb-a847-a43fd4f0f9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:54.206216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc789d-0fec-41eb-a847-a43fd4f0f9cd None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:54.206216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc789d-0fec-41eb-a847-a43fd4f0f9cd None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:54.206216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc789d-0fec-41eb-a847-a43fd4f0f9cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:54.217281 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc789d-0fec-41eb-a847-a43fd4f0f9cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:54.226428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-54fc789d-0fec-41eb-a847-a43fd4f0f9cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:46:54.226428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:54.226428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:54.226428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:54.226428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:54.226428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:54.226428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:54.226428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:54.226428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:54.226428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:54.226428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:54.226428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:54.226428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:54.226428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:54.226428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:54.226428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:54.227686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:54.227686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:54.227686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:54.227686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:54.227686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:54.227686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:54.227686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:54.227686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:54.227686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:54.227686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:54.227686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:54.227686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:46:54.227686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:54.227686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:54.227686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:54.227686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:54.228431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:54.228431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:54.228431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:54.228431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:54.228431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:54.228431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:54.228431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:54.228431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:54.228431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:54.228431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:54.228431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:46:54.228431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:46:54.228431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 81/158] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:46:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:46:54.234880 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc789d-0fec-41eb-a847-a43fd4f0f9cd None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:54.332557 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb50767-6b80-459a-af3a-f671f705c804 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:54.363804 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc789d-0fec-41eb-a847-a43fd4f0f9cd None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:54.375868 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18353b3-04cc-4d52-8c56-c07994ae37aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:54.377290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18353b3-04cc-4d52-8c56-c07994ae37aa None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:54.377911 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18353b3-04cc-4d52-8c56-c07994ae37aa None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:54.378364 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18353b3-04cc-4d52-8c56-c07994ae37aa None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:54.380353 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18353b3-04cc-4d52-8c56-c07994ae37aa None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:54.382831 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18353b3-04cc-4d52-8c56-c07994ae37aa None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:54.384901 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 78/159] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:46:54 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:46:54.391181 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18353b3-04cc-4d52-8c56-c07994ae37aa None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:54.407926 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a8476-dd62-4b36-b385-576673a672ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:54.408752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a8476-dd62-4b36-b385-576673a672ea None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:54.409064 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a8476-dd62-4b36-b385-576673a672ea None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:54.409407 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a8476-dd62-4b36-b385-576673a672ea None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:54.410258 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a8476-dd62-4b36-b385-576673a672ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:54.410629 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a8476-dd62-4b36-b385-576673a672ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:54.412074 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a8476-dd62-4b36-b385-576673a672ea None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:54.421609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 82/160] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:46:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:54.423122 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09016abe-8b29-44c5-b924-34fee43afc8d None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:54.423478 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09016abe-8b29-44c5-b924-34fee43afc8d None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:54.423823 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09016abe-8b29-44c5-b924-34fee43afc8d None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:54.425134 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 83/161] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:54.429971 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09016abe-8b29-44c5-b924-34fee43afc8d None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:54.510920 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18353b3-04cc-4d52-8c56-c07994ae37aa None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:54.537208 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09016abe-8b29-44c5-b924-34fee43afc8d None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:54.554562 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad3699-9f07-41e1-98b4-ba882b70ef5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:54.555285 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad3699-9f07-41e1-98b4-ba882b70ef5d None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:54.555585 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad3699-9f07-41e1-98b4-ba882b70ef5d None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:54.555825 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad3699-9f07-41e1-98b4-ba882b70ef5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:54.556656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad3699-9f07-41e1-98b4-ba882b70ef5d None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e, user.id=3409da654b054b979d2c52a756bb7ee6) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:54.556962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad3699-9f07-41e1-98b4-ba882b70ef5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:54.558545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad3699-9f07-41e1-98b4-ba882b70ef5d None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:54.564791 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 79/162] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:46:54 2022] GET /identity/v3/role_assignments?user.id=3409da654b054b979d2c52a756bb7ee6&scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e&role.id=52d3ad3e32c741938997691c9a909b81 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:54.565974 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9c1f1-cd6a-4baa-bc1a-15f1b083bf8f None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:54.566199 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9c1f1-cd6a-4baa-bc1a-15f1b083bf8f None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:54.566467 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9c1f1-cd6a-4baa-bc1a-15f1b083bf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:54.575327 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986330d-c084-447f-9394-38639f695dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:54.576229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986330d-c084-447f-9394-38639f695dd3 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:54.576508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986330d-c084-447f-9394-38639f695dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:54.576780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986330d-c084-447f-9394-38639f695dd3 None admin] PATH_INFO: `/v3/users/19fe19561183438eb6b5c3d8e14b53c3` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:54.584084 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986330d-c084-447f-9394-38639f695dd3 None admin] RBAC: Authorizing `identity:get_user(user_id=19fe19561183438eb6b5c3d8e14b53c3)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:54.584992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986330d-c084-447f-9394-38639f695dd3 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:54.589486 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 84/163] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:54 2022] GET /identity/v3/users/19fe19561183438eb6b5c3d8e14b53c3 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:54.590721 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6335b55-5206-46da-8d32-bac628c3db4d None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:54.591009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6335b55-5206-46da-8d32-bac628c3db4d None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:54.591285 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6335b55-5206-46da-8d32-bac628c3db4d None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:54.592746 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 85/164] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:54.596905 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6335b55-5206-46da-8d32-bac628c3db4d None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:54.598228 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-01c9c1f1-cd6a-4baa-bc1a-15f1b083bf8f None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:54.599440 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-01c9c1f1-cd6a-4baa-bc1a-15f1b083bf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:54.682493 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 80/165] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:54.684117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c201e-a5c5-4930-888f-2f627afae399 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:54.684604 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c201e-a5c5-4930-888f-2f627afae399 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:54.685109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c201e-a5c5-4930-888f-2f627afae399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:54.714938 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-089c201e-a5c5-4930-888f-2f627afae399 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:54.716473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-089c201e-a5c5-4930-888f-2f627afae399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:54.738469 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6335b55-5206-46da-8d32-bac628c3db4d None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:54.788068 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b0481-31e2-4bd5-90f9-5e38b549b6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:54.788959 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b0481-31e2-4bd5-90f9-5e38b549b6e6 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:54.789243 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b0481-31e2-4bd5-90f9-5e38b549b6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:54.789618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b0481-31e2-4bd5-90f9-5e38b549b6e6 None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:54.794639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b0481-31e2-4bd5-90f9-5e38b549b6e6 None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:54.796142 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b0481-31e2-4bd5-90f9-5e38b549b6e6 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:54.798163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 86/166] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:46:54 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:54.798915 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b0481-31e2-4bd5-90f9-5e38b549b6e6 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:54.800339 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 81/167] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:54.804820 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c201e-a5c5-4930-888f-2f627afae399 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:54.899223 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b0481-31e2-4bd5-90f9-5e38b549b6e6 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:54.903543 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c201e-a5c5-4930-888f-2f627afae399 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:54.935182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0699b-35b8-4c0b-ab4c-e3c9145f154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:54.935957 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0699b-35b8-4c0b-ab4c-e3c9145f154a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:54.936331 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0699b-35b8-4c0b-ab4c-e3c9145f154a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:54.936663 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0699b-35b8-4c0b-ab4c-e3c9145f154a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:54.939760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab2671-e1cf-4621-9c68-b3ba33cfac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:54.940886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab2671-e1cf-4621-9c68-b3ba33cfac92 None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:54.941370 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab2671-e1cf-4621-9c68-b3ba33cfac92 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:54.941851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab2671-e1cf-4621-9c68-b3ba33cfac92 None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e/users/19fe19561183438eb6b5c3d8e14b53c3/roles/2f97989a57b241f18734bf5df7ebe048` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:54.944914 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab2671-e1cf-4621-9c68-b3ba33cfac92 None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb6e6402b314d21a8beef0b41fcae2e, user_id=19fe19561183438eb6b5c3d8e14b53c3, role_id=2f97989a57b241f18734bf5df7ebe048)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:54.947028 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab2671-e1cf-4621-9c68-b3ba33cfac92 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:54.948342 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0699b-35b8-4c0b-ab4c-e3c9145f154a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:54.958573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-7ca0699b-35b8-4c0b-ab4c-e3c9145f154a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:46:54.958573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:54.958573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:54.958573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:54.958573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:54.958573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:54.958573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:54.958573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:54.958573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:54.958573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:54.958573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:54.958573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:54.958573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:54.958573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:54.958573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:54.958573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:54.959523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:54.959523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:54.959523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:54.959523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:54.959523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:54.959523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:54.959523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:54.959523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:54.959523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:54.959523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:54.959523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:54.959523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:46:54.959523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:54.959523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:54.959523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:54.959523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:54.960340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:54.960340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:54.960340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:54.960340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:54.960340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:54.960340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:54.960340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:54.960340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:54.960340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:54.960340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:54.960340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:46:54.960340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:46:54.960942 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 87/168] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:46:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:46:54.966155 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0699b-35b8-4c0b-ab4c-e3c9145f154a None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:54.974692 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 82/169] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:46:54 2022] PUT /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e/users/19fe19561183438eb6b5c3d8e14b53c3/roles/2f97989a57b241f18734bf5df7ebe048 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:46:54.976623 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab2671-e1cf-4621-9c68-b3ba33cfac92 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:55.150924 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0699b-35b8-4c0b-ab4c-e3c9145f154a None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:55.161102 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab2671-e1cf-4621-9c68-b3ba33cfac92 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:55.203843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4344b-9d32-4342-b6df-53e682fa486e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:55.204967 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4344b-9d32-4342-b6df-53e682fa486e None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:55.205318 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4344b-9d32-4342-b6df-53e682fa486e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:55.205658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4344b-9d32-4342-b6df-53e682fa486e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:55.219186 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4344b-9d32-4342-b6df-53e682fa486e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:55.229172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-24c4344b-9d32-4342-b6df-53e682fa486e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:46:55.229172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:55.229172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:55.229172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:55.229172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:55.229172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:55.229172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:55.229172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:55.229172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:55.229172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:55.229172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:55.229172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:55.229172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:55.229172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:55.229172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:55.229172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:55.230180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:55.230180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:55.230180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:55.230180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:55.230180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:55.230180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:55.230180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:55.230180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:55.230180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:55.230180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:55.230180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:55.230180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:46:55.230180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:55.230180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:55.230180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:55.230180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:55.230944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:55.230944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:55.230944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:55.230944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:55.230944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:55.230944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:55.230944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:55.230944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:55.230944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:55.230944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:55.230944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:46:55.230944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:46:55.230944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 88/170] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:46:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:46:55.237398 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4344b-9d32-4342-b6df-53e682fa486e None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:55.243385 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3122a-db1f-4f6e-8da8-117913398baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:55.244608 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3122a-db1f-4f6e-8da8-117913398baa None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:55.245094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3122a-db1f-4f6e-8da8-117913398baa None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:55.245554 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3122a-db1f-4f6e-8da8-117913398baa None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:55.246536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3122a-db1f-4f6e-8da8-117913398baa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:55.247028 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3122a-db1f-4f6e-8da8-117913398baa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:55.248658 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3122a-db1f-4f6e-8da8-117913398baa None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:55.260787 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 83/171] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:46:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:55.271835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3122a-db1f-4f6e-8da8-117913398baa None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:55.356303 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4344b-9d32-4342-b6df-53e682fa486e None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:55.394243 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcf114-10af-4b72-86fd-2a06c0e9b223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:55.394921 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcf114-10af-4b72-86fd-2a06c0e9b223 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:55.395203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcf114-10af-4b72-86fd-2a06c0e9b223 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:55.395484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcf114-10af-4b72-86fd-2a06c0e9b223 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:55.396436 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcf114-10af-4b72-86fd-2a06c0e9b223 None admin] RBAC: Adding query filter params (name=member) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:55.396728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcf114-10af-4b72-86fd-2a06c0e9b223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:55.398474 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcf114-10af-4b72-86fd-2a06c0e9b223 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:55.408466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 89/172] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:46:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:46:55.414949 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcf114-10af-4b72-86fd-2a06c0e9b223 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:55.465739 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3122a-db1f-4f6e-8da8-117913398baa None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:55.499115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f040e-0b53-4ab2-a92e-9860c75cb94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:55.500355 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f040e-0b53-4ab2-a92e-9860c75cb94b None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:55.500857 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f040e-0b53-4ab2-a92e-9860c75cb94b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:55.501310 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f040e-0b53-4ab2-a92e-9860c75cb94b None admin] PATH_INFO: `/v3/users/73fc2af7c3ea4c41af7c840384744887` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:55.502924 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f040e-0b53-4ab2-a92e-9860c75cb94b None admin] RBAC: Authorizing `identity:get_user(user_id=73fc2af7c3ea4c41af7c840384744887)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:55.504578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f040e-0b53-4ab2-a92e-9860c75cb94b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:55.506477 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 84/173] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:55 2022] GET /identity/v3/users/73fc2af7c3ea4c41af7c840384744887 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:55.531574 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f040e-0b53-4ab2-a92e-9860c75cb94b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:55.537077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcf114-10af-4b72-86fd-2a06c0e9b223 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:55.576379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5234445-06eb-4774-8a4b-a24783354ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:55.576379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5234445-06eb-4774-8a4b-a24783354ac8 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:55.576379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5234445-06eb-4774-8a4b-a24783354ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:55.576379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5234445-06eb-4774-8a4b-a24783354ac8 None admin] PATH_INFO: `/v3/users/73fc2af7c3ea4c41af7c840384744887` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:55.577565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5234445-06eb-4774-8a4b-a24783354ac8 None admin] RBAC: Authorizing `identity:get_user(user_id=73fc2af7c3ea4c41af7c840384744887)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:55.579428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5234445-06eb-4774-8a4b-a24783354ac8 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:55.581339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 90/174] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:55 2022] GET /identity/v3/users/73fc2af7c3ea4c41af7c840384744887 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:46:55.587422 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5234445-06eb-4774-8a4b-a24783354ac8 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:55.698346 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5234445-06eb-4774-8a4b-a24783354ac8 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:55.737715 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d0bbd-17bf-4bbe-ba8e-99806443ab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:55.738617 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d0bbd-17bf-4bbe-ba8e-99806443ab7a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:55.738902 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d0bbd-17bf-4bbe-ba8e-99806443ab7a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:55.739176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d0bbd-17bf-4bbe-ba8e-99806443ab7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:55.771739 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f040e-0b53-4ab2-a92e-9860c75cb94b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:55.814087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d0bbd-17bf-4bbe-ba8e-99806443ab7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:55.815863 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d0bbd-17bf-4bbe-ba8e-99806443ab7a None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:55.851044 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176ebc2-4dbc-4201-8297-13992f3a6344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:55.851699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176ebc2-4dbc-4201-8297-13992f3a6344 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:55.852057 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176ebc2-4dbc-4201-8297-13992f3a6344 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:55.852344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176ebc2-4dbc-4201-8297-13992f3a6344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:55.921109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 91/175] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:46:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 09:46:55.926606 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d0bbd-17bf-4bbe-ba8e-99806443ab7a None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:55.970352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176ebc2-4dbc-4201-8297-13992f3a6344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:55.971830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176ebc2-4dbc-4201-8297-13992f3a6344 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:56.025639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d0bbd-17bf-4bbe-ba8e-99806443ab7a None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:56.060504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963294b-2865-4677-90c9-dfa14268393c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:56.061369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963294b-2865-4677-90c9-dfa14268393c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:56.061649 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963294b-2865-4677-90c9-dfa14268393c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:56.061968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963294b-2865-4677-90c9-dfa14268393c None admin] PATH_INFO: `/v3/projects/b4fbe9b579bd464ba4d132d4171e9c48` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:56.063166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963294b-2865-4677-90c9-dfa14268393c None admin] RBAC: Authorizing `identity:get_project(project_id=b4fbe9b579bd464ba4d132d4171e9c48)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:56.064615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963294b-2865-4677-90c9-dfa14268393c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:56.066372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 92/176] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:46:55 2022] GET /identity/v3/projects/b4fbe9b579bd464ba4d132d4171e9c48 => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:46:56.072368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963294b-2865-4677-90c9-dfa14268393c None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:56.084134 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 85/177] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:46:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 09:46:56.104160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176ebc2-4dbc-4201-8297-13992f3a6344 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:56.176270 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963294b-2865-4677-90c9-dfa14268393c None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:56.224373 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa050e-e748-4125-b368-43b8c74e696a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:56.225034 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa050e-e748-4125-b368-43b8c74e696a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:56.225321 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa050e-e748-4125-b368-43b8c74e696a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:56.225589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa050e-e748-4125-b368-43b8c74e696a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:56.226459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa050e-e748-4125-b368-43b8c74e696a None admin] RBAC: Adding query filter params (role.id=9e77c7f209fd4468bcf1b89bfef3c236, scope.project.id=b4fbe9b579bd464ba4d132d4171e9c48, user.id=73fc2af7c3ea4c41af7c840384744887) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:56.226767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa050e-e748-4125-b368-43b8c74e696a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:56.232453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa050e-e748-4125-b368-43b8c74e696a None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:56.241054 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 93/178] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:46:56 2022] GET /identity/v3/role_assignments?user.id=73fc2af7c3ea4c41af7c840384744887&scope.project.id=b4fbe9b579bd464ba4d132d4171e9c48&role.id=9e77c7f209fd4468bcf1b89bfef3c236 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:56.272953 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176ebc2-4dbc-4201-8297-13992f3a6344 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:56.334296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56687b05-ff05-4fff-b7d6-e0b6e3c76a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:56.335185 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687b05-ff05-4fff-b7d6-e0b6e3c76a36 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:56.335465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687b05-ff05-4fff-b7d6-e0b6e3c76a36 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:56.335736 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687b05-ff05-4fff-b7d6-e0b6e3c76a36 None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:56.337373 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56687b05-ff05-4fff-b7d6-e0b6e3c76a36 None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:56.338842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56687b05-ff05-4fff-b7d6-e0b6e3c76a36 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:56.340854 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 86/179] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:46:56 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:46:56.346832 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa050e-e748-4125-b368-43b8c74e696a None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:56.462406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa050e-e748-4125-b368-43b8c74e696a None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:56.509890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c6761-a8b9-439c-b147-a3c0d5b06872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:56.510549 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c6761-a8b9-439c-b147-a3c0d5b06872 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:56.510823 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c6761-a8b9-439c-b147-a3c0d5b06872 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:56.511090 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c6761-a8b9-439c-b147-a3c0d5b06872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:56.511925 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c6761-a8b9-439c-b147-a3c0d5b06872 None admin] RBAC: Adding query filter params (role.id=cb8032f764644c90a3dc0cb396434d67, scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e, user.id=73fc2af7c3ea4c41af7c840384744887) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:56.512226 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c6761-a8b9-439c-b147-a3c0d5b06872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:56.513657 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c6761-a8b9-439c-b147-a3c0d5b06872 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:56.522344 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 94/180] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:46:56 2022] GET /identity/v3/role_assignments?user.id=73fc2af7c3ea4c41af7c840384744887&scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e&role.id=cb8032f764644c90a3dc0cb396434d67 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:57.120573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d30a4-15f2-4d97-a798-eb30ba4a0bb5 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:57.120573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d30a4-15f2-4d97-a798-eb30ba4a0bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:57.120573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d30a4-15f2-4d97-a798-eb30ba4a0bb5 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:57.121515 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 87/181] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:57.125682 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c723cee-96f5-45ca-ab4f-8a873e282ca0 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:57.126443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c723cee-96f5-45ca-ab4f-8a873e282ca0 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:57.126858 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c723cee-96f5-45ca-ab4f-8a873e282ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:57.145113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-1c723cee-96f5-45ca-ab4f-8a873e282ca0 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:57.146581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-1c723cee-96f5-45ca-ab4f-8a873e282ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:57.219015 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 95/182] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:57.241685 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d30a4-15f2-4d97-a798-eb30ba4a0bb5 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:57.346067 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d30a4-15f2-4d97-a798-eb30ba4a0bb5 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:57.380436 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6992efd-ebfc-4b6a-8915-b65840ad95dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:57.381652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6992efd-ebfc-4b6a-8915-b65840ad95dd None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:57.382146 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6992efd-ebfc-4b6a-8915-b65840ad95dd None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:57.382915 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6992efd-ebfc-4b6a-8915-b65840ad95dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:57.393925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6992efd-ebfc-4b6a-8915-b65840ad95dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:57.402241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-f6992efd-ebfc-4b6a-8915-b65840ad95dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:46:57.402241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:57.402241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:57.402241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:57.402241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:57.402241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:57.402241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:57.402241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:57.402241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:57.402241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:57.402241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:57.402241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:57.402241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:57.402241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:57.402241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:57.402241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:57.403106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:57.403106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:57.403106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:57.403106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:57.403106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:57.403106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:57.403106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:57.403106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:57.403106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:57.403106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:57.403106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:57.403106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:46:57.403106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:57.403106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:57.403106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:57.403106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:57.403902 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:57.403902 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:57.403902 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:57.403902 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:57.403902 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:57.403902 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:57.403902 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:57.403902 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:57.403902 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:57.403902 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:57.403902 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:46:57.403902 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:46:57.405959 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 88/183] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:46:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:46:57.414846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c723cee-96f5-45ca-ab4f-8a873e282ca0 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:57.510187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c723cee-96f5-45ca-ab4f-8a873e282ca0 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:57.548941 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b9823-e20a-45ef-8578-ee876fe70bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:57.549616 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b9823-e20a-45ef-8578-ee876fe70bee None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:57.549925 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b9823-e20a-45ef-8578-ee876fe70bee None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:57.550197 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b9823-e20a-45ef-8578-ee876fe70bee None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:57.550948 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b9823-e20a-45ef-8578-ee876fe70bee None admin] RBAC: Adding query filter params (name=admin) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:57.551249 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b9823-e20a-45ef-8578-ee876fe70bee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:57.552632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b9823-e20a-45ef-8578-ee876fe70bee None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:57.561581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 96/184] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:46:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:57.567389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6992efd-ebfc-4b6a-8915-b65840ad95dd None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:57.662825 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6992efd-ebfc-4b6a-8915-b65840ad95dd None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:57.689377 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e570888-2a7d-4419-9f97-18b34b6519fb None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:57.689661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e570888-2a7d-4419-9f97-18b34b6519fb None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:57.689991 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e570888-2a7d-4419-9f97-18b34b6519fb None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:57.691503 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 97/185] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:46:57.696228 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947ad81-a780-4349-90dc-18c0a193e181 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:57.696617 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947ad81-a780-4349-90dc-18c0a193e181 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:57.696902 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947ad81-a780-4349-90dc-18c0a193e181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:57.699448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dae634-f20a-4fdc-995b-978e0c22f841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:57.700254 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dae634-f20a-4fdc-995b-978e0c22f841 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:57.700526 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dae634-f20a-4fdc-995b-978e0c22f841 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:57.700797 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dae634-f20a-4fdc-995b-978e0c22f841 None admin] PATH_INFO: `/v3/users/3d7e74a11b4447eebedce0b34d4c2f7f` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:57.714531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-8947ad81-a780-4349-90dc-18c0a193e181 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:57.715692 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-8947ad81-a780-4349-90dc-18c0a193e181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:57.716373 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dae634-f20a-4fdc-995b-978e0c22f841 None admin] RBAC: Authorizing `identity:get_user(user_id=3d7e74a11b4447eebedce0b34d4c2f7f)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:57.717870 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dae634-f20a-4fdc-995b-978e0c22f841 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:57.719781 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 89/186] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:57 2022] GET /identity/v3/users/3d7e74a11b4447eebedce0b34d4c2f7f => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:57.725006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dae634-f20a-4fdc-995b-978e0c22f841 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:57.796972 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 98/187] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:46:57.819612 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947ad81-a780-4349-90dc-18c0a193e181 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:57.842347 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dae634-f20a-4fdc-995b-978e0c22f841 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:57.885695 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16eb063-9c91-4bad-be52-6e339cdd5d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:57.886385 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16eb063-9c91-4bad-be52-6e339cdd5d1b None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:57.886661 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16eb063-9c91-4bad-be52-6e339cdd5d1b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:57.886931 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16eb063-9c91-4bad-be52-6e339cdd5d1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:57.929379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947ad81-a780-4349-90dc-18c0a193e181 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:57.953136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16eb063-9c91-4bad-be52-6e339cdd5d1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:57.954635 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16eb063-9c91-4bad-be52-6e339cdd5d1b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:57.964776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb294e-fb74-4e28-a889-1df3975b031d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:57.965585 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb294e-fb74-4e28-a889-1df3975b031d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:57.965884 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb294e-fb74-4e28-a889-1df3975b031d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:57.966155 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb294e-fb74-4e28-a889-1df3975b031d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:57.976341 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb294e-fb74-4e28-a889-1df3975b031d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:57.984831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-6dbb294e-fb74-4e28-a889-1df3975b031d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:46:57.984831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:57.984831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:57.984831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:57.984831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:57.984831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:57.984831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:57.984831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:57.984831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:57.984831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:57.984831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:57.984831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:57.984831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:57.984831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:57.984831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:57.984831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:57.985690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:57.985690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:57.985690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:57.985690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:57.985690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:57.985690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:57.985690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:57.985690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:57.985690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:57.985690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:57.985690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:57.985690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:46:57.985690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:57.985690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:57.985690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:57.985690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:57.986493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:57.986493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:57.986493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:57.986493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:57.986493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:57.986493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:57.986493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:57.986493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:57.986493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:57.986493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:57.986493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:46:57.986493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:46:57.986493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 99/188] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:46:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:46:57.987675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1417f61-3c34-4296-8d9f-bf962b9eb63f None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:57.987675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1417f61-3c34-4296-8d9f-bf962b9eb63f None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:57.987796 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1417f61-3c34-4296-8d9f-bf962b9eb63f None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:57.989917 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 100/189] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:57.994619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313fb31-f956-452b-abba-24aaacf33351 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:57.994904 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313fb31-f956-452b-abba-24aaacf33351 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:57.995178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313fb31-f956-452b-abba-24aaacf33351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:58.011690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-e313fb31-f956-452b-abba-24aaacf33351 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:58.012850 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-e313fb31-f956-452b-abba-24aaacf33351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:58.052365 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 90/190] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:46:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:46:58.053044 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16eb063-9c91-4bad-be52-6e339cdd5d1b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:58.076935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 101/191] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:58.078399 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143de169-65b1-451c-95fc-bff4416d041b None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:58.078676 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143de169-65b1-451c-95fc-bff4416d041b None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:58.078915 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143de169-65b1-451c-95fc-bff4416d041b None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:58.080162 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 102/192] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:46:58.080836 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143de169-65b1-451c-95fc-bff4416d041b None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:58.148638 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16eb063-9c91-4bad-be52-6e339cdd5d1b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:58.177581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143de169-65b1-451c-95fc-bff4416d041b None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:58.181004 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b9a8b-52d0-4d6c-8a34-3a5d669d5e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:58.181609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b9a8b-52d0-4d6c-8a34-3a5d669d5e2f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:58.181913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b9a8b-52d0-4d6c-8a34-3a5d669d5e2f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:58.182180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b9a8b-52d0-4d6c-8a34-3a5d669d5e2f None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:58.182907 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b9a8b-52d0-4d6c-8a34-3a5d669d5e2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:58.183208 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b9a8b-52d0-4d6c-8a34-3a5d669d5e2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:58.184579 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b9a8b-52d0-4d6c-8a34-3a5d669d5e2f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:58.192510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 91/193] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:46:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:58.193481 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd867-f24c-4031-9458-3d89056d9454 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:58.193762 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd867-f24c-4031-9458-3d89056d9454 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:58.194083 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd867-f24c-4031-9458-3d89056d9454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:58.210579 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-4e4bd867-f24c-4031-9458-3d89056d9454 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:46:58.211924 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-4e4bd867-f24c-4031-9458-3d89056d9454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:46:58.212824 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b72f8-7a4b-405a-aa4a-22adc21df985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:58.213692 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b72f8-7a4b-405a-aa4a-22adc21df985 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:58.214067 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b72f8-7a4b-405a-aa4a-22adc21df985 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:58.214339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b72f8-7a4b-405a-aa4a-22adc21df985 None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:58.215516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b72f8-7a4b-405a-aa4a-22adc21df985 None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:58.216950 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b72f8-7a4b-405a-aa4a-22adc21df985 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:58.218850 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 103/194] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:46:58 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:58.219416 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b72f8-7a4b-405a-aa4a-22adc21df985 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:58.276199 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 92/195] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:46:58.277044 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bd867-f24c-4031-9458-3d89056d9454 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:58.316367 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b72f8-7a4b-405a-aa4a-22adc21df985 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:58.351291 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b80e05-58c2-48e1-822c-8b49443d76ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:58.352083 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80e05-58c2-48e1-822c-8b49443d76ad None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:58.352363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80e05-58c2-48e1-822c-8b49443d76ad None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:58.352626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80e05-58c2-48e1-822c-8b49443d76ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:58.353850 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b80e05-58c2-48e1-822c-8b49443d76ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:58.355289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b80e05-58c2-48e1-822c-8b49443d76ad None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:58.356902 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 104/196] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:46:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:58.357668 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b80e05-58c2-48e1-822c-8b49443d76ad None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:58.371454 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bd867-f24c-4031-9458-3d89056d9454 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:58.403715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3239144-58dc-41e0-8e8a-9dcae27cde6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:58.404594 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3239144-58dc-41e0-8e8a-9dcae27cde6a None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:58.404867 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3239144-58dc-41e0-8e8a-9dcae27cde6a None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:58.405141 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3239144-58dc-41e0-8e8a-9dcae27cde6a None admin] PATH_INFO: `/v3/users/3d7e74a11b4447eebedce0b34d4c2f7f` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:58.406346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3239144-58dc-41e0-8e8a-9dcae27cde6a None admin] RBAC: Authorizing `identity:get_user(user_id=3d7e74a11b4447eebedce0b34d4c2f7f)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:58.407772 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3239144-58dc-41e0-8e8a-9dcae27cde6a None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:58.409381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 93/197] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:58 2022] GET /identity/v3/users/3d7e74a11b4447eebedce0b34d4c2f7f => generated 283 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:58.410155 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3239144-58dc-41e0-8e8a-9dcae27cde6a None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:58.453395 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b80e05-58c2-48e1-822c-8b49443d76ad None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:58.487587 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d95b5-e54b-4cce-b65a-00380f678564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:58.488247 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d95b5-e54b-4cce-b65a-00380f678564 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:58.488524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d95b5-e54b-4cce-b65a-00380f678564 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:58.488791 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d95b5-e54b-4cce-b65a-00380f678564 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:58.489631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d95b5-e54b-4cce-b65a-00380f678564 None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=8a5cae0345914eccba509f41e0ddf7a5, user.id=3d7e74a11b4447eebedce0b34d4c2f7f) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:58.489964 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d95b5-e54b-4cce-b65a-00380f678564 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:58.491417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d95b5-e54b-4cce-b65a-00380f678564 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:58.497220 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 105/198] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:46:58 2022] GET /identity/v3/role_assignments?user.id=3d7e74a11b4447eebedce0b34d4c2f7f&scope.project.id=8a5cae0345914eccba509f41e0ddf7a5&role.id=52d3ad3e32c741938997691c9a909b81 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:58.498015 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d95b5-e54b-4cce-b65a-00380f678564 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:58.501055 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3239144-58dc-41e0-8e8a-9dcae27cde6a None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:58.538586 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ceed8-5b8f-4e4f-9496-ee8b85497eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:58.539890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ceed8-5b8f-4e4f-9496-ee8b85497eb6 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:58.540421 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ceed8-5b8f-4e4f-9496-ee8b85497eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:58.540897 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ceed8-5b8f-4e4f-9496-ee8b85497eb6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:58.552150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ceed8-5b8f-4e4f-9496-ee8b85497eb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:46:58.560584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-f89ceed8-5b8f-4e4f-9496-ee8b85497eb6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:46:58.560584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:46:58.560584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:46:58.560584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:46:58.560584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:46:58.560584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:46:58.560584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:46:58.560584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:46:58.560584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:46:58.560584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:46:58.560584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:46:58.560584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:46:58.560584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:46:58.560584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:46:58.560584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:46:58.560584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:46:58.561580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:46:58.561580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:46:58.561580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:46:58.561580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:46:58.561580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:46:58.561580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:46:58.561580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:46:58.561580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:46:58.561580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:46:58.561580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:46:58.561580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:46:58.561580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:46:58.561580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:46:58.561580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:46:58.561580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:46:58.561580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:46:58.562386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:46:58.562386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:46:58.562386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:46:58.562386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:46:58.562386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:46:58.562386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:46:58.562386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:46:58.562386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:46:58.562386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:46:58.562386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:46:58.562386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:46:58.562386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:46:58.568369 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 94/199] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:46:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:46:58.568369 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ceed8-5b8f-4e4f-9496-ee8b85497eb6 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:58.603675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d95b5-e54b-4cce-b65a-00380f678564 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:58.637185 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db63936-d95d-48dc-89b6-7de7251c7bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:58.637909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db63936-d95d-48dc-89b6-7de7251c7bbe None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:58.638191 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db63936-d95d-48dc-89b6-7de7251c7bbe None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:58.638467 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db63936-d95d-48dc-89b6-7de7251c7bbe None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:58.639193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db63936-d95d-48dc-89b6-7de7251c7bbe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:58.640687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db63936-d95d-48dc-89b6-7de7251c7bbe None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:58.669293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 106/200] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:46:58 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:46:58.670632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db63936-d95d-48dc-89b6-7de7251c7bbe None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:58.682099 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ceed8-5b8f-4e4f-9496-ee8b85497eb6 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:58.724634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28703d3-8d65-437b-b97c-a3728b40d258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:58.725462 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28703d3-8d65-437b-b97c-a3728b40d258 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:58.725830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28703d3-8d65-437b-b97c-a3728b40d258 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:58.726249 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28703d3-8d65-437b-b97c-a3728b40d258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:58.806681 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db63936-d95d-48dc-89b6-7de7251c7bbe None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:58.819514 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28703d3-8d65-437b-b97c-a3728b40d258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:58.822033 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28703d3-8d65-437b-b97c-a3728b40d258 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:58.857282 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48ffa2-541d-4c28-9237-26af6d618db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:58.858240 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48ffa2-541d-4c28-9237-26af6d618db0 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:58.858643 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48ffa2-541d-4c28-9237-26af6d618db0 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:58.861021 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48ffa2-541d-4c28-9237-26af6d618db0 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:58.861021 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48ffa2-541d-4c28-9237-26af6d618db0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:58.861375 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48ffa2-541d-4c28-9237-26af6d618db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:58.862928 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48ffa2-541d-4c28-9237-26af6d618db0 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:58.873035 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 107/201] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:46:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:58.878600 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48ffa2-541d-4c28-9237-26af6d618db0 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:58.937780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 95/202] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:46:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:46:58.943716 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28703d3-8d65-437b-b97c-a3728b40d258 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:59.003377 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48ffa2-541d-4c28-9237-26af6d618db0 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:59.046648 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e32b9-3c9b-4f5c-891f-ca26db506107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:59.047529 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e32b9-3c9b-4f5c-891f-ca26db506107 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:59.047810 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e32b9-3c9b-4f5c-891f-ca26db506107 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:59.048091 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e32b9-3c9b-4f5c-891f-ca26db506107 None admin] PATH_INFO: `/v3/users/19fe19561183438eb6b5c3d8e14b53c3` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:59.049266 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e32b9-3c9b-4f5c-891f-ca26db506107 None admin] RBAC: Authorizing `identity:get_user(user_id=19fe19561183438eb6b5c3d8e14b53c3)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:59.050794 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e32b9-3c9b-4f5c-891f-ca26db506107 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:59.052602 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 108/203] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:46:58 2022] GET /identity/v3/users/19fe19561183438eb6b5c3d8e14b53c3 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:46:59.058657 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e32b9-3c9b-4f5c-891f-ca26db506107 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:59.068964 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28703d3-8d65-437b-b97c-a3728b40d258 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:59.109065 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac561af-6808-40bf-8e73-700b24cde9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:59.110088 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac561af-6808-40bf-8e73-700b24cde9ac None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:59.110352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac561af-6808-40bf-8e73-700b24cde9ac None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:59.110725 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac561af-6808-40bf-8e73-700b24cde9ac None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:59.111971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac561af-6808-40bf-8e73-700b24cde9ac None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:59.113478 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac561af-6808-40bf-8e73-700b24cde9ac None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:59.115343 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 96/204] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:46:58 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:46:59.123679 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac561af-6808-40bf-8e73-700b24cde9ac None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:59.165857 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e32b9-3c9b-4f5c-891f-ca26db506107 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:59.201843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fafa14-011c-4d15-8432-905e1415720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:59.203217 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fafa14-011c-4d15-8432-905e1415720c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:59.203671 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fafa14-011c-4d15-8432-905e1415720c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:59.204106 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fafa14-011c-4d15-8432-905e1415720c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:59.224309 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac561af-6808-40bf-8e73-700b24cde9ac None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:59.260181 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee35c6-66f5-4303-82b6-b86913d78392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:59.260887 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee35c6-66f5-4303-82b6-b86913d78392 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:59.261324 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee35c6-66f5-4303-82b6-b86913d78392 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:59.261546 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee35c6-66f5-4303-82b6-b86913d78392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:59.262568 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee35c6-66f5-4303-82b6-b86913d78392 None admin] RBAC: Adding query filter params (role.id=cb8032f764644c90a3dc0cb396434d67, scope.project.id=8a5cae0345914eccba509f41e0ddf7a5, user.id=3d7e74a11b4447eebedce0b34d4c2f7f) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:59.262905 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee35c6-66f5-4303-82b6-b86913d78392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:59.264457 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee35c6-66f5-4303-82b6-b86913d78392 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:59.271568 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 97/205] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:46:59 2022] GET /identity/v3/role_assignments?user.id=3d7e74a11b4447eebedce0b34d4c2f7f&scope.project.id=8a5cae0345914eccba509f41e0ddf7a5&role.id=cb8032f764644c90a3dc0cb396434d67 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:59.275281 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fafa14-011c-4d15-8432-905e1415720c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:59.277000 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fafa14-011c-4d15-8432-905e1415720c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:59.384218 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 109/206] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:46:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:46:59.389989 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee35c6-66f5-4303-82b6-b86913d78392 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:59.517831 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee35c6-66f5-4303-82b6-b86913d78392 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:59.552326 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3a1a2-c5e9-4c41-b508-1306ca403a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:59.553551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3a1a2-c5e9-4c41-b508-1306ca403a6d None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:59.554087 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3a1a2-c5e9-4c41-b508-1306ca403a6d None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:59.554550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3a1a2-c5e9-4c41-b508-1306ca403a6d None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:59.556068 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3a1a2-c5e9-4c41-b508-1306ca403a6d None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:59.557735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3a1a2-c5e9-4c41-b508-1306ca403a6d None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:59.559971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 98/207] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:46:59 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:46:59.567153 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fafa14-011c-4d15-8432-905e1415720c None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:46:59.725282 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fafa14-011c-4d15-8432-905e1415720c None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:46:59.768110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe18ad4-1a41-4b6c-9550-1a8d31323b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:46:59.768689 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe18ad4-1a41-4b6c-9550-1a8d31323b9c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:46:59.768967 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe18ad4-1a41-4b6c-9550-1a8d31323b9c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:46:59.769240 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe18ad4-1a41-4b6c-9550-1a8d31323b9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:46:59.770105 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe18ad4-1a41-4b6c-9550-1a8d31323b9c None admin] RBAC: Adding query filter params (role.id=2f97989a57b241f18734bf5df7ebe048, scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e, user.id=19fe19561183438eb6b5c3d8e14b53c3) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:46:59.770411 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe18ad4-1a41-4b6c-9550-1a8d31323b9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:46:59.771843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe18ad4-1a41-4b6c-9550-1a8d31323b9c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:46:59.778159 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 110/208] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:46:59 2022] GET /identity/v3/role_assignments?user.id=19fe19561183438eb6b5c3d8e14b53c3&scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e&role.id=2f97989a57b241f18734bf5df7ebe048 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:00.914209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c6e1a-5115-45f4-a411-0aac5478ba6a None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:00.915493 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c6e1a-5115-45f4-a411-0aac5478ba6a None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:00.915980 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c6e1a-5115-45f4-a411-0aac5478ba6a None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:00.917556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 99/209] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:00.923072 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb598f-4ba2-46b4-a661-d84ba6ec32de None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:00.923479 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb598f-4ba2-46b4-a661-d84ba6ec32de None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:00.923665 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb598f-4ba2-46b4-a661-d84ba6ec32de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:00.940316 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-12fb598f-4ba2-46b4-a661-d84ba6ec32de None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:00.941489 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-12fb598f-4ba2-46b4-a661-d84ba6ec32de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:01.006158 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 111/210] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:01.029286 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c6e1a-5115-45f4-a411-0aac5478ba6a None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:01.125069 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c6e1a-5115-45f4-a411-0aac5478ba6a None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:01.162940 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3cfad-70da-4a88-a934-9c4ecac18244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:01.164101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3cfad-70da-4a88-a934-9c4ecac18244 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:01.164706 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3cfad-70da-4a88-a934-9c4ecac18244 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:01.165174 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3cfad-70da-4a88-a934-9c4ecac18244 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:01.176357 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3cfad-70da-4a88-a934-9c4ecac18244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:01.184381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-62b3cfad-70da-4a88-a934-9c4ecac18244 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:47:01.184381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:01.184381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:01.184381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:01.184381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:01.184381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:01.184381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:01.184381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:01.184381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:01.184381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:01.184381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:01.184381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:01.184381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:01.184381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:01.184381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:01.184381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:01.185275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:01.185275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:01.185275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:01.185275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:01.185275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:01.185275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:01.185275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:01.185275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:01.185275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:01.185275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:01.185275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:01.185275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:01.185275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:01.185275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:01.185275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:01.185275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:01.186092 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:01.186092 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:01.186092 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:01.186092 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:01.186092 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:01.186092 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:01.186092 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:01.186092 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:01.186092 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:01.186092 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:01.186092 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:47:01.186092 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:01.188824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 100/211] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:47:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:01.196210 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb598f-4ba2-46b4-a661-d84ba6ec32de None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:01.299646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb598f-4ba2-46b4-a661-d84ba6ec32de None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:01.327226 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb57bd2-7524-4318-8c4c-5e96c12391dc None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:01.327876 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb57bd2-7524-4318-8c4c-5e96c12391dc None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:01.328336 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb57bd2-7524-4318-8c4c-5e96c12391dc None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:01.330065 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 101/212] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:47:01.332926 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7871a-7f0c-40db-a75f-b0ec267b84c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:01.333561 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7871a-7f0c-40db-a75f-b0ec267b84c1 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:01.333856 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7871a-7f0c-40db-a75f-b0ec267b84c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:01.334130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7871a-7f0c-40db-a75f-b0ec267b84c1 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:01.334960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7871a-7f0c-40db-a75f-b0ec267b84c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:01.335275 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7871a-7f0c-40db-a75f-b0ec267b84c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:01.336616 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959969c-7cbd-46ad-b54c-f311281ad809 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:01.336737 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7871a-7f0c-40db-a75f-b0ec267b84c1 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:01.337346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959969c-7cbd-46ad-b54c-f311281ad809 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:01.337860 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959969c-7cbd-46ad-b54c-f311281ad809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:01.349895 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 112/213] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:01.352594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7871a-7f0c-40db-a75f-b0ec267b84c1 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:01.357769 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-9959969c-7cbd-46ad-b54c-f311281ad809 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:01.359216 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-9959969c-7cbd-46ad-b54c-f311281ad809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:01.425133 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 102/214] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:47:01.450120 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959969c-7cbd-46ad-b54c-f311281ad809 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:01.454926 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7871a-7f0c-40db-a75f-b0ec267b84c1 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:01.489816 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f645f-703e-4390-842d-81a1c236455c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:01.490765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f645f-703e-4390-842d-81a1c236455c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:01.491045 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f645f-703e-4390-842d-81a1c236455c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:01.491309 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f645f-703e-4390-842d-81a1c236455c None admin] PATH_INFO: `/v3/users/3d7e74a11b4447eebedce0b34d4c2f7f` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:01.492851 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f645f-703e-4390-842d-81a1c236455c None admin] RBAC: Authorizing `identity:get_user(user_id=3d7e74a11b4447eebedce0b34d4c2f7f)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:01.494831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f645f-703e-4390-842d-81a1c236455c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:01.501514 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 113/215] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:47:01 2022] GET /identity/v3/users/3d7e74a11b4447eebedce0b34d4c2f7f => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:01.503092 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f645f-703e-4390-842d-81a1c236455c None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:01.556558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959969c-7cbd-46ad-b54c-f311281ad809 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:01.590434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63e43b-bcb8-4760-bc6e-5bab2b08c8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:01.591626 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63e43b-bcb8-4760-bc6e-5bab2b08c8b7 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:01.592091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63e43b-bcb8-4760-bc6e-5bab2b08c8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:01.592542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63e43b-bcb8-4760-bc6e-5bab2b08c8b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:01.602991 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63e43b-bcb8-4760-bc6e-5bab2b08c8b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:01.606034 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f645f-703e-4390-842d-81a1c236455c None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:01.610984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-ad63e43b-bcb8-4760-bc6e-5bab2b08c8b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:01.610984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:01.610984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:01.610984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:01.610984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:01.610984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:01.610984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:01.610984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:01.610984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:01.610984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:01.610984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:01.610984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:01.610984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:01.610984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:01.610984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:01.610984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:01.611855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:01.611855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:01.611855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:01.611855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:01.611855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:01.611855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:01.611855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:01.611855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:01.611855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:01.611855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:01.611855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:01.611855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:01.611855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:01.611855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:01.611855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:01.611855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:01.612637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:01.612637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:01.612637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:01.612637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:01.612637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:01.612637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:01.612637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:01.612637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:01.612637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:01.612637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:01.612637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:01.612637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:01.614979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 103/216] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:01.620949 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63e43b-bcb8-4760-bc6e-5bab2b08c8b7 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:01.640230 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072f391-5c80-4a72-9cd7-1108a9416f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:01.641151 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072f391-5c80-4a72-9cd7-1108a9416f1a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:01.641466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072f391-5c80-4a72-9cd7-1108a9416f1a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:01.641740 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072f391-5c80-4a72-9cd7-1108a9416f1a None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:01.642976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072f391-5c80-4a72-9cd7-1108a9416f1a None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:01.644615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072f391-5c80-4a72-9cd7-1108a9416f1a None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:01.646567 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 114/217] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:01 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:01.655582 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072f391-5c80-4a72-9cd7-1108a9416f1a None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:01.725114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63e43b-bcb8-4760-bc6e-5bab2b08c8b7 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:01.749425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072f391-5c80-4a72-9cd7-1108a9416f1a None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:01.756996 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229814e2-0c3f-4088-b9a9-fe4e129462de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:01.758018 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229814e2-0c3f-4088-b9a9-fe4e129462de None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:01.758289 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229814e2-0c3f-4088-b9a9-fe4e129462de None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:01.758558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229814e2-0c3f-4088-b9a9-fe4e129462de None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:01.759293 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229814e2-0c3f-4088-b9a9-fe4e129462de None admin] RBAC: Adding query filter params (name=member) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:01.759593 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229814e2-0c3f-4088-b9a9-fe4e129462de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:01.760949 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229814e2-0c3f-4088-b9a9-fe4e129462de None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:01.768739 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 104/218] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:01.770993 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f534ed-6593-4d22-b2eb-1df1b08de7c4 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:01.771276 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f534ed-6593-4d22-b2eb-1df1b08de7c4 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:01.771567 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f534ed-6593-4d22-b2eb-1df1b08de7c4 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:01.774159 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 105/219] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:01.774159 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbf8e8-01ec-472d-8095-86bc4cca2482 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:01.774331 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbf8e8-01ec-472d-8095-86bc4cca2482 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:01.774540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbf8e8-01ec-472d-8095-86bc4cca2482 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:01.775835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 106/220] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:01.778688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbf8e8-01ec-472d-8095-86bc4cca2482 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:01.784594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12eaa3-6fea-48f7-acab-9a157cf88d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:01.785482 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12eaa3-6fea-48f7-acab-9a157cf88d86 None admin] REQUEST_METHOD: `PUT` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:01.785758 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12eaa3-6fea-48f7-acab-9a157cf88d86 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:01.786053 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12eaa3-6fea-48f7-acab-9a157cf88d86 None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5/users/3d7e74a11b4447eebedce0b34d4c2f7f/roles/52d3ad3e32c741938997691c9a909b81` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:01.788064 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12eaa3-6fea-48f7-acab-9a157cf88d86 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a5cae0345914eccba509f41e0ddf7a5, user_id=3d7e74a11b4447eebedce0b34d4c2f7f, role_id=52d3ad3e32c741938997691c9a909b81)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:01.789820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12eaa3-6fea-48f7-acab-9a157cf88d86 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:01.802974 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 115/221] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:47:01 2022] PUT /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5/users/3d7e74a11b4447eebedce0b34d4c2f7f/roles/52d3ad3e32c741938997691c9a909b81 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:47:01.804186 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e87a6-3d62-441f-a2e8-e91f4c32c656 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:01.804469 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e87a6-3d62-441f-a2e8-e91f4c32c656 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:01.804739 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e87a6-3d62-441f-a2e8-e91f4c32c656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:01.831486 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-7f4e87a6-3d62-441f-a2e8-e91f4c32c656 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:01.832692 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-7f4e87a6-3d62-441f-a2e8-e91f4c32c656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:01.883398 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbf8e8-01ec-472d-8095-86bc4cca2482 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:01.909145 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 116/222] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:01.910801 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b2b66-f14e-413c-8e21-20dd1b22bb38 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:01.911283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b2b66-f14e-413c-8e21-20dd1b22bb38 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:01.911741 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b2b66-f14e-413c-8e21-20dd1b22bb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:01.923203 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ecfe2-3e22-4256-8fa5-accedd92db80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:01.929285 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ecfe2-3e22-4256-8fa5-accedd92db80 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:01.930221 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ecfe2-3e22-4256-8fa5-accedd92db80 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:01.930507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ecfe2-3e22-4256-8fa5-accedd92db80 None admin] PATH_INFO: `/v3/users/6ae0b6b8c8de4ecea7cf451f6c0fbe3e` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:01.935884 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-546b2b66-f14e-413c-8e21-20dd1b22bb38 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:01.937068 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-546b2b66-f14e-413c-8e21-20dd1b22bb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:01.945375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ecfe2-3e22-4256-8fa5-accedd92db80 None admin] RBAC: Authorizing `identity:get_user(user_id=6ae0b6b8c8de4ecea7cf451f6c0fbe3e)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:01.947316 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ecfe2-3e22-4256-8fa5-accedd92db80 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:01.949114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 107/223] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:47:01 2022] GET /identity/v3/users/6ae0b6b8c8de4ecea7cf451f6c0fbe3e => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:01.949114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ecfe2-3e22-4256-8fa5-accedd92db80 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:02.010456 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 117/224] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:02.011231 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b2b66-f14e-413c-8e21-20dd1b22bb38 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:02.047704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ecfe2-3e22-4256-8fa5-accedd92db80 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:02.080949 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa78909-0cb0-4b48-9c88-38c9d960603d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:02.081882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa78909-0cb0-4b48-9c88-38c9d960603d None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:02.082218 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa78909-0cb0-4b48-9c88-38c9d960603d None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:02.082554 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa78909-0cb0-4b48-9c88-38c9d960603d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:02.083767 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa78909-0cb0-4b48-9c88-38c9d960603d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:02.085268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa78909-0cb0-4b48-9c88-38c9d960603d None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:02.087269 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 108/225] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:02.087869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa78909-0cb0-4b48-9c88-38c9d960603d None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:02.109820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b2b66-f14e-413c-8e21-20dd1b22bb38 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:02.142122 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101a877-8105-4003-98fa-eb4613f48316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:02.142770 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101a877-8105-4003-98fa-eb4613f48316 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:02.143046 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101a877-8105-4003-98fa-eb4613f48316 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:02.143310 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101a877-8105-4003-98fa-eb4613f48316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:02.179975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa78909-0cb0-4b48-9c88-38c9d960603d None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:02.207672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101a877-8105-4003-98fa-eb4613f48316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:02.209127 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101a877-8105-4003-98fa-eb4613f48316 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:02.218370 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3579a-849d-4b52-affe-76cf6730dd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:02.219177 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3579a-849d-4b52-affe-76cf6730dd7b None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:02.219449 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3579a-849d-4b52-affe-76cf6730dd7b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:02.219711 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3579a-849d-4b52-affe-76cf6730dd7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:02.230810 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3579a-849d-4b52-affe-76cf6730dd7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:02.238705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-d3c3579a-849d-4b52-affe-76cf6730dd7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:02.238705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:02.238705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:02.238705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:02.238705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:02.238705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:02.238705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:02.238705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:02.238705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:02.238705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:02.238705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:02.238705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:02.238705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:02.238705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:02.238705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:02.238705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:02.239723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:02.239723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:02.239723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:02.239723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:02.239723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:02.239723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:02.239723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:02.239723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:02.239723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:02.239723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:02.239723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:02.239723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:02.239723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:02.239723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:02.239723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:02.239723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:02.240609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:02.240609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:02.240609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:02.240609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:02.240609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:02.240609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:02.240609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:02.240609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:02.240609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:02.240609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:02.240609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:02.240609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:02.240609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 109/226] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:47:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:02.241394 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3579a-849d-4b52-affe-76cf6730dd7b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:02.315481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 118/227] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:02.315481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101a877-8105-4003-98fa-eb4613f48316 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:02.351385 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3579a-849d-4b52-affe-76cf6730dd7b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:02.382375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fe3f5-0657-4dd8-b217-df1d9ffa9b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:02.383404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fe3f5-0657-4dd8-b217-df1d9ffa9b56 None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:02.383713 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fe3f5-0657-4dd8-b217-df1d9ffa9b56 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:02.384025 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fe3f5-0657-4dd8-b217-df1d9ffa9b56 None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:02.384732 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fe3f5-0657-4dd8-b217-df1d9ffa9b56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:02.386255 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fe3f5-0657-4dd8-b217-df1d9ffa9b56 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:02.405744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 110/228] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:47:02 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:47:02.406578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fe3f5-0657-4dd8-b217-df1d9ffa9b56 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:02.412885 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101a877-8105-4003-98fa-eb4613f48316 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:02.449624 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3aab9f-2082-4123-ba6c-3396c979353b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:02.450673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3aab9f-2082-4123-ba6c-3396c979353b None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:02.451086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3aab9f-2082-4123-ba6c-3396c979353b None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:02.451501 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3aab9f-2082-4123-ba6c-3396c979353b None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:02.452299 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3aab9f-2082-4123-ba6c-3396c979353b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:02.452759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3aab9f-2082-4123-ba6c-3396c979353b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:02.454504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3aab9f-2082-4123-ba6c-3396c979353b None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:02.463679 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 119/229] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:02.469341 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3aab9f-2082-4123-ba6c-3396c979353b None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:02.542129 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fe3f5-0657-4dd8-b217-df1d9ffa9b56 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:02.570917 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3aab9f-2082-4123-ba6c-3396c979353b None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:02.584124 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a765f-d3ec-4480-af10-642234d1f9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:02.585365 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a765f-d3ec-4480-af10-642234d1f9d6 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:02.586155 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a765f-d3ec-4480-af10-642234d1f9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:02.586590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a765f-d3ec-4480-af10-642234d1f9d6 None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:02.588234 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a765f-d3ec-4480-af10-642234d1f9d6 None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:02.590329 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a765f-d3ec-4480-af10-642234d1f9d6 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:02.592245 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 111/230] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:02 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:02.598639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a765f-d3ec-4480-af10-642234d1f9d6 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:02.616065 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcb299-b43b-422f-8e3a-920c6a1d6ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:02.617313 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcb299-b43b-422f-8e3a-920c6a1d6ccc None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:02.617667 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcb299-b43b-422f-8e3a-920c6a1d6ccc None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:02.617993 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcb299-b43b-422f-8e3a-920c6a1d6ccc None admin] PATH_INFO: `/v3/users/3d7e74a11b4447eebedce0b34d4c2f7f` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:02.619421 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcb299-b43b-422f-8e3a-920c6a1d6ccc None admin] RBAC: Authorizing `identity:get_user(user_id=3d7e74a11b4447eebedce0b34d4c2f7f)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:02.621704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcb299-b43b-422f-8e3a-920c6a1d6ccc None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:02.623452 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 120/231] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:47:02 2022] GET /identity/v3/users/3d7e74a11b4447eebedce0b34d4c2f7f => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:02.630568 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcb299-b43b-422f-8e3a-920c6a1d6ccc None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:02.713829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a765f-d3ec-4480-af10-642234d1f9d6 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:02.759861 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcb299-b43b-422f-8e3a-920c6a1d6ccc None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:02.762370 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e413de-c10c-4800-8527-882ab7cc70e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:02.763029 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e413de-c10c-4800-8527-882ab7cc70e1 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:02.763305 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e413de-c10c-4800-8527-882ab7cc70e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:02.763574 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e413de-c10c-4800-8527-882ab7cc70e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:02.764403 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e413de-c10c-4800-8527-882ab7cc70e1 None admin] RBAC: Adding query filter params (role.id=9e77c7f209fd4468bcf1b89bfef3c236, scope.project.id=8a5cae0345914eccba509f41e0ddf7a5, user.id=6ae0b6b8c8de4ecea7cf451f6c0fbe3e) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:02.764709 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e413de-c10c-4800-8527-882ab7cc70e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:02.768300 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e413de-c10c-4800-8527-882ab7cc70e1 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:02.775243 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 112/232] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:47:02 2022] GET /identity/v3/role_assignments?user.id=6ae0b6b8c8de4ecea7cf451f6c0fbe3e&scope.project.id=8a5cae0345914eccba509f41e0ddf7a5&role.id=9e77c7f209fd4468bcf1b89bfef3c236 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:02.799065 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88fc9d-6794-4a18-819b-3edf5ed29be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:02.800275 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88fc9d-6794-4a18-819b-3edf5ed29be9 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:02.800763 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88fc9d-6794-4a18-819b-3edf5ed29be9 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:02.801236 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88fc9d-6794-4a18-819b-3edf5ed29be9 None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:02.802803 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88fc9d-6794-4a18-819b-3edf5ed29be9 None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:02.804532 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88fc9d-6794-4a18-819b-3edf5ed29be9 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:02.807049 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 121/233] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:02 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:02.812975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e413de-c10c-4800-8527-882ab7cc70e1 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:02.920284 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e413de-c10c-4800-8527-882ab7cc70e1 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:02.959928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc75e6-4d99-4725-ba64-b768cfc354ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:02.960860 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc75e6-4d99-4725-ba64-b768cfc354ba None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:02.961165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc75e6-4d99-4725-ba64-b768cfc354ba None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:02.961442 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc75e6-4d99-4725-ba64-b768cfc354ba None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5/users/3d7e74a11b4447eebedce0b34d4c2f7f/roles/cb8032f764644c90a3dc0cb396434d67` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:02.964061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc75e6-4d99-4725-ba64-b768cfc354ba None admin] RBAC: Authorizing `identity:create_grant(project_id=8a5cae0345914eccba509f41e0ddf7a5, user_id=3d7e74a11b4447eebedce0b34d4c2f7f, role_id=cb8032f764644c90a3dc0cb396434d67)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:02.965557 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc75e6-4d99-4725-ba64-b768cfc354ba None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:02.987389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 113/234] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:47:02 2022] PUT /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5/users/3d7e74a11b4447eebedce0b34d4c2f7f/roles/cb8032f764644c90a3dc0cb396434d67 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:47:04.294761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870497b2-21bd-43ea-88c8-72f4549a1ed1 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:04.295212 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870497b2-21bd-43ea-88c8-72f4549a1ed1 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:04.295286 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870497b2-21bd-43ea-88c8-72f4549a1ed1 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:04.297991 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 122/235] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:04.303374 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a62590-b8cf-49cc-b639-72b14546b5c4 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:04.303812 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a62590-b8cf-49cc-b639-72b14546b5c4 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:04.303925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a62590-b8cf-49cc-b639-72b14546b5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:04.329911 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-a5a62590-b8cf-49cc-b639-72b14546b5c4 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:04.331299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-a5a62590-b8cf-49cc-b639-72b14546b5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:04.427145 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 114/236] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:04.462104 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870497b2-21bd-43ea-88c8-72f4549a1ed1 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:04.588059 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870497b2-21bd-43ea-88c8-72f4549a1ed1 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:04.634505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c5c0f-4ef7-4853-9629-b16a21feeb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:04.635536 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c5c0f-4ef7-4853-9629-b16a21feeb70 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:04.635949 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c5c0f-4ef7-4853-9629-b16a21feeb70 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:04.636372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c5c0f-4ef7-4853-9629-b16a21feeb70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:04.650261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c5c0f-4ef7-4853-9629-b16a21feeb70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:04.658079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-c04c5c0f-4ef7-4853-9629-b16a21feeb70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:47:04.658079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:04.658079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:04.658079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:04.658079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:04.658079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:04.658079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:04.658079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:04.658079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:04.658079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:04.658079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:04.658079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:04.658079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:04.658079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:04.658079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:04.658079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:04.659128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:04.659128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:04.659128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:04.659128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:04.659128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:04.659128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:04.659128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:04.659128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:04.659128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:04.659128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:04.659128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:04.659128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:04.659128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:04.659128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:04.659128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:04.659128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:04.660111 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:04.660111 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:04.660111 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:04.660111 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:04.660111 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:04.660111 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:04.660111 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:04.660111 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:04.660111 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:04.660111 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:04.660111 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:47:04.660111 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:04.662143 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 123/237] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:47:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:04.668231 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a62590-b8cf-49cc-b639-72b14546b5c4 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:04.794350 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a62590-b8cf-49cc-b639-72b14546b5c4 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:04.832755 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b609181-b439-4a65-ba64-36e40dcdab45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:04.833671 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b609181-b439-4a65-ba64-36e40dcdab45 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:04.834108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b609181-b439-4a65-ba64-36e40dcdab45 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:04.834542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b609181-b439-4a65-ba64-36e40dcdab45 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:04.835423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b609181-b439-4a65-ba64-36e40dcdab45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:04.835859 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b609181-b439-4a65-ba64-36e40dcdab45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:04.837440 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b609181-b439-4a65-ba64-36e40dcdab45 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:04.851561 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 115/238] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:04.852877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c5c0f-4ef7-4853-9629-b16a21feeb70 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:04.981299 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c5c0f-4ef7-4853-9629-b16a21feeb70 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:05.027353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888d4af-ae43-447c-bc58-a015789d3fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:05.028469 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888d4af-ae43-447c-bc58-a015789d3fe4 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:05.028903 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888d4af-ae43-447c-bc58-a015789d3fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:05.030700 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888d4af-ae43-447c-bc58-a015789d3fe4 None admin] PATH_INFO: `/v3/users/3d7e74a11b4447eebedce0b34d4c2f7f` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:05.032039 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888d4af-ae43-447c-bc58-a015789d3fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=3d7e74a11b4447eebedce0b34d4c2f7f)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:05.033625 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888d4af-ae43-447c-bc58-a015789d3fe4 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:05.036112 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 124/239] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:47:04 2022] GET /identity/v3/users/3d7e74a11b4447eebedce0b34d4c2f7f => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:05.038027 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04449da-c449-484c-893b-65b1d0c4a2cc None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:05.038513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04449da-c449-484c-893b-65b1d0c4a2cc None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:05.038948 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04449da-c449-484c-893b-65b1d0c4a2cc None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:05.041885 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888d4af-ae43-447c-bc58-a015789d3fe4 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:05.042610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 116/240] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:05.057493 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a01d9-5142-4330-9ebb-2fd9dffac83e None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:05.058052 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a01d9-5142-4330-9ebb-2fd9dffac83e None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:05.058468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a01d9-5142-4330-9ebb-2fd9dffac83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:05.076793 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-835a01d9-5142-4330-9ebb-2fd9dffac83e None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:05.078264 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-835a01d9-5142-4330-9ebb-2fd9dffac83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:05.191239 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 117/241] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:47:05.210123 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888d4af-ae43-447c-bc58-a015789d3fe4 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:05.235289 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a01d9-5142-4330-9ebb-2fd9dffac83e None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:05.271510 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd655a0-78d5-460e-be5d-928fc2ffeade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:05.272473 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd655a0-78d5-460e-be5d-928fc2ffeade None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:05.272927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd655a0-78d5-460e-be5d-928fc2ffeade None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:05.273360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd655a0-78d5-460e-be5d-928fc2ffeade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:05.367885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a01d9-5142-4330-9ebb-2fd9dffac83e None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:05.401565 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c78099-9086-495d-a433-d7dde48991ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:05.402648 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78099-9086-495d-a433-d7dde48991ef None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:05.403078 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78099-9086-495d-a433-d7dde48991ef None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:05.403477 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78099-9086-495d-a433-d7dde48991ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:05.407342 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd655a0-78d5-460e-be5d-928fc2ffeade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:05.408843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd655a0-78d5-460e-be5d-928fc2ffeade None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:05.415374 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c78099-9086-495d-a433-d7dde48991ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:05.423388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-a2c78099-9086-495d-a433-d7dde48991ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:47:05.423388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:05.423388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:05.423388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:05.423388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:05.423388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:05.423388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:05.423388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:05.423388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:05.423388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:05.423388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:05.423388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:05.423388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:05.423388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:05.423388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:05.423388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:05.424450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:05.424450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:05.424450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:05.424450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:05.424450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:05.424450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:05.424450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:05.424450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:05.424450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:05.424450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:05.424450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:05.424450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:05.424450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:05.424450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:05.424450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:05.424450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:05.425423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:05.425423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:05.425423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:05.425423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:05.425423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:05.425423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:05.425423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:05.425423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:05.425423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:05.425423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:05.425423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:47:05.425423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:05.427346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 118/242] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:05.434264 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c78099-9086-495d-a433-d7dde48991ef None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:05.549033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 125/243] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 09:47:05.550390 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787f970-827e-4a3b-ba25-0575e0737181 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:05.550672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787f970-827e-4a3b-ba25-0575e0737181 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:05.550939 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787f970-827e-4a3b-ba25-0575e0737181 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:05.552165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c78099-9086-495d-a433-d7dde48991ef None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:05.552276 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 126/244] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:05.558402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316d664-31f9-490e-a3ec-8f53934cda34 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:05.558684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316d664-31f9-490e-a3ec-8f53934cda34 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:05.558961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316d664-31f9-490e-a3ec-8f53934cda34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:05.576187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-2316d664-31f9-490e-a3ec-8f53934cda34 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:05.577345 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-2316d664-31f9-490e-a3ec-8f53934cda34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:05.587455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaac548-4f9e-416a-9f90-9885b4861930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:05.588353 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaac548-4f9e-416a-9f90-9885b4861930 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:05.588767 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaac548-4f9e-416a-9f90-9885b4861930 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:05.589174 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaac548-4f9e-416a-9f90-9885b4861930 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:05.590080 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaac548-4f9e-416a-9f90-9885b4861930 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:05.590534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaac548-4f9e-416a-9f90-9885b4861930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:05.592040 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaac548-4f9e-416a-9f90-9885b4861930 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:05.600936 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 119/245] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:05.602198 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaac548-4f9e-416a-9f90-9885b4861930 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:05.642464 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 127/246] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:05.643301 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316d664-31f9-490e-a3ec-8f53934cda34 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:05.701531 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaac548-4f9e-416a-9f90-9885b4861930 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:05.735503 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2f9cb-98bb-432e-9c4e-b65e4058d257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:05.736369 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2f9cb-98bb-432e-9c4e-b65e4058d257 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:05.736643 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2f9cb-98bb-432e-9c4e-b65e4058d257 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:05.736910 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2f9cb-98bb-432e-9c4e-b65e4058d257 None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:05.737771 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316d664-31f9-490e-a3ec-8f53934cda34 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:05.738094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2f9cb-98bb-432e-9c4e-b65e4058d257 None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:05.739534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2f9cb-98bb-432e-9c4e-b65e4058d257 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:05.746139 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 120/247] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:05 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:05.746139 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2f9cb-98bb-432e-9c4e-b65e4058d257 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:05.771773 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68a899-0ab8-464f-9d17-1439fd8578fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:05.772642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68a899-0ab8-464f-9d17-1439fd8578fc None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:05.772915 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68a899-0ab8-464f-9d17-1439fd8578fc None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:05.773177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68a899-0ab8-464f-9d17-1439fd8578fc None admin] PATH_INFO: `/v3/users/ad2ee143dd4c4445b30fb0c88944b922` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:05.785971 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68a899-0ab8-464f-9d17-1439fd8578fc None admin] RBAC: Authorizing `identity:get_user(user_id=ad2ee143dd4c4445b30fb0c88944b922)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:05.787474 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68a899-0ab8-464f-9d17-1439fd8578fc None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:05.789156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 128/248] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:47:05 2022] GET /identity/v3/users/ad2ee143dd4c4445b30fb0c88944b922 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:05.793854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca631da-f97f-437c-938d-605a66542dd9 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:05.793854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca631da-f97f-437c-938d-605a66542dd9 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:05.793854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca631da-f97f-437c-938d-605a66542dd9 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:05.793854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 129/249] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:05.793854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca631da-f97f-437c-938d-605a66542dd9 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:05.852341 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2f9cb-98bb-432e-9c4e-b65e4058d257 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:05.886138 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5b800-6fcf-48c3-8d7a-429ff4a5a92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:05.886989 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5b800-6fcf-48c3-8d7a-429ff4a5a92c None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:05.887267 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5b800-6fcf-48c3-8d7a-429ff4a5a92c None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:05.887537 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5b800-6fcf-48c3-8d7a-429ff4a5a92c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:05.888783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5b800-6fcf-48c3-8d7a-429ff4a5a92c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:05.890278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5b800-6fcf-48c3-8d7a-429ff4a5a92c None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:05.896751 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 121/250] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:05.897242 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5b800-6fcf-48c3-8d7a-429ff4a5a92c None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:05.898014 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca631da-f97f-437c-938d-605a66542dd9 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:05.930976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85974a82-b0f5-4333-9108-8f0c508653e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:05.931635 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85974a82-b0f5-4333-9108-8f0c508653e0 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:05.931910 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85974a82-b0f5-4333-9108-8f0c508653e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:05.932185 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85974a82-b0f5-4333-9108-8f0c508653e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:05.933017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85974a82-b0f5-4333-9108-8f0c508653e0 None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=8a5cae0345914eccba509f41e0ddf7a5, user.id=3d7e74a11b4447eebedce0b34d4c2f7f) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:05.933319 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85974a82-b0f5-4333-9108-8f0c508653e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:05.934785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85974a82-b0f5-4333-9108-8f0c508653e0 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:05.949396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 130/251] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:47:05 2022] GET /identity/v3/role_assignments?user.id=3d7e74a11b4447eebedce0b34d4c2f7f&scope.project.id=8a5cae0345914eccba509f41e0ddf7a5&role.id=52d3ad3e32c741938997691c9a909b81 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:05.949396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98976ee7-f213-4894-a58a-db53692f6d52 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:05.949396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98976ee7-f213-4894-a58a-db53692f6d52 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:05.949396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98976ee7-f213-4894-a58a-db53692f6d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:05.958786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-98976ee7-f213-4894-a58a-db53692f6d52 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:05.959971 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-98976ee7-f213-4894-a58a-db53692f6d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:06.021225 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5b800-6fcf-48c3-8d7a-429ff4a5a92c None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:06.027911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 131/252] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:06.028755 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98976ee7-f213-4894-a58a-db53692f6d52 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:06.056826 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aec90-614a-47c5-8fa0-868344bd754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:06.057483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aec90-614a-47c5-8fa0-868344bd754d None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:06.057760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aec90-614a-47c5-8fa0-868344bd754d None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:06.058070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aec90-614a-47c5-8fa0-868344bd754d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:06.126063 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5aec90-614a-47c5-8fa0-868344bd754d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:06.127457 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5aec90-614a-47c5-8fa0-868344bd754d None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:06.131460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98976ee7-f213-4894-a58a-db53692f6d52 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:06.166398 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42531f-9f67-40b0-95e1-74ed3f782241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:06.167107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42531f-9f67-40b0-95e1-74ed3f782241 None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:06.167376 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42531f-9f67-40b0-95e1-74ed3f782241 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:06.167644 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42531f-9f67-40b0-95e1-74ed3f782241 None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:06.168360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42531f-9f67-40b0-95e1-74ed3f782241 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:06.169956 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42531f-9f67-40b0-95e1-74ed3f782241 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:06.191975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 132/253] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:47:06 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:47:06.193702 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d8350-18a8-439d-92e3-1158aaccfba2 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:06.194140 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d8350-18a8-439d-92e3-1158aaccfba2 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:06.194572 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d8350-18a8-439d-92e3-1158aaccfba2 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:06.196443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 133/254] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:06.197444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d8350-18a8-439d-92e3-1158aaccfba2 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:06.257078 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 122/255] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:06.258232 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6490ed-d252-472e-a74b-97a6e9915799 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:06.258514 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6490ed-d252-472e-a74b-97a6e9915799 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:06.258782 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6490ed-d252-472e-a74b-97a6e9915799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:06.276415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-1a6490ed-d252-472e-a74b-97a6e9915799 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:06.277601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-1a6490ed-d252-472e-a74b-97a6e9915799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:06.320363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d8350-18a8-439d-92e3-1158aaccfba2 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:06.346880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 123/256] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:06.348091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6490ed-d252-472e-a74b-97a6e9915799 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:06.354637 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0ab3d-80ac-43d0-830b-46c1edd08a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:06.355457 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0ab3d-80ac-43d0-830b-46c1edd08a41 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:06.355732 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0ab3d-80ac-43d0-830b-46c1edd08a41 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:06.355997 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0ab3d-80ac-43d0-830b-46c1edd08a41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:06.367494 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0ab3d-80ac-43d0-830b-46c1edd08a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:06.375813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-50c0ab3d-80ac-43d0-830b-46c1edd08a41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:06.375813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:06.375813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:06.375813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:06.375813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:06.375813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:06.375813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:06.375813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:06.375813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:06.375813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:06.375813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:06.375813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:06.375813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:06.375813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:06.375813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:06.375813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:06.376937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:06.376937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:06.376937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:06.376937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:06.376937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:06.376937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:06.376937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:06.376937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:06.376937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:06.376937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:06.376937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:06.376937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:06.376937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:06.376937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:06.376937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:06.376937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:06.377733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:06.377733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:06.377733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:06.377733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:06.377733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:06.377733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:06.377733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:06.377733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:06.377733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:06.377733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:06.377733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:06.377733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:06.377733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 134/257] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:47:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:06.382417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0ab3d-80ac-43d0-830b-46c1edd08a41 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:06.470072 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6490ed-d252-472e-a74b-97a6e9915799 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:06.485053 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0ab3d-80ac-43d0-830b-46c1edd08a41 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:06.509959 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a644cb-1e03-476f-81af-7b137b6e7346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:06.511554 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a644cb-1e03-476f-81af-7b137b6e7346 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:06.511662 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a644cb-1e03-476f-81af-7b137b6e7346 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:06.512504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a644cb-1e03-476f-81af-7b137b6e7346 None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:06.513107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a644cb-1e03-476f-81af-7b137b6e7346 None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:06.514602 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a644cb-1e03-476f-81af-7b137b6e7346 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:06.516321 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 124/258] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:06 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:06.517091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a644cb-1e03-476f-81af-7b137b6e7346 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:06.528967 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ab4c5-e5a8-4a99-8a83-a4a0b4889bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:06.530209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ab4c5-e5a8-4a99-8a83-a4a0b4889bd1 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:06.531083 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ab4c5-e5a8-4a99-8a83-a4a0b4889bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:06.531508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ab4c5-e5a8-4a99-8a83-a4a0b4889bd1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:06.554212 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ab4c5-e5a8-4a99-8a83-a4a0b4889bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:06.563597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-7d1ab4c5-e5a8-4a99-8a83-a4a0b4889bd1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:06.563597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:06.563597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:06.563597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:06.563597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:06.563597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:06.563597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:06.563597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:06.563597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:06.563597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:06.563597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:06.563597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:06.563597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:06.563597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:06.563597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:06.563597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:06.564516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:06.564516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:06.564516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:06.564516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:06.564516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:06.564516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:06.564516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:06.564516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:06.564516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:06.564516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:06.564516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:06.564516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:06.564516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:06.564516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:06.564516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:06.564516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:06.565308 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:06.565308 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:06.565308 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:06.565308 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:06.565308 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:06.565308 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:06.565308 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:06.565308 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:06.565308 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:06.565308 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:06.565308 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:06.565308 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:06.565308 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 135/259] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:06.565977 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ab4c5-e5a8-4a99-8a83-a4a0b4889bd1 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:06.643015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a644cb-1e03-476f-81af-7b137b6e7346 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:06.688337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe2a77-220b-4d86-ad0c-64d3013b3e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:06.689432 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe2a77-220b-4d86-ad0c-64d3013b3e09 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:06.689955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe2a77-220b-4d86-ad0c-64d3013b3e09 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:06.690435 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe2a77-220b-4d86-ad0c-64d3013b3e09 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:06.691402 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe2a77-220b-4d86-ad0c-64d3013b3e09 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:06.691891 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe2a77-220b-4d86-ad0c-64d3013b3e09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:06.693446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe2a77-220b-4d86-ad0c-64d3013b3e09 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:06.708843 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 125/260] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:06.714558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe2a77-220b-4d86-ad0c-64d3013b3e09 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:06.817198 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ab4c5-e5a8-4a99-8a83-a4a0b4889bd1 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:06.826958 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe2a77-220b-4d86-ad0c-64d3013b3e09 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:06.854976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4729b3-fcbe-4e9c-9030-9aac752cb085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:06.855611 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4729b3-fcbe-4e9c-9030-9aac752cb085 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:06.855894 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4729b3-fcbe-4e9c-9030-9aac752cb085 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:06.856171 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4729b3-fcbe-4e9c-9030-9aac752cb085 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:06.857242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4729b3-fcbe-4e9c-9030-9aac752cb085 None admin] RBAC: Adding query filter params (role.id=2f97989a57b241f18734bf5df7ebe048, scope.project.id=8a5cae0345914eccba509f41e0ddf7a5, user.id=ad2ee143dd4c4445b30fb0c88944b922) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:06.857602 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4729b3-fcbe-4e9c-9030-9aac752cb085 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:06.859584 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4729b3-fcbe-4e9c-9030-9aac752cb085 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:06.867550 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 136/261] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:47:06 2022] GET /identity/v3/role_assignments?user.id=ad2ee143dd4c4445b30fb0c88944b922&scope.project.id=8a5cae0345914eccba509f41e0ddf7a5&role.id=2f97989a57b241f18734bf5df7ebe048 => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:06.868359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4729b3-fcbe-4e9c-9030-9aac752cb085 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:06.871395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef2a28-1674-49c9-a097-7d9b383ace4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:06.873407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef2a28-1674-49c9-a097-7d9b383ace4b None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:06.874210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef2a28-1674-49c9-a097-7d9b383ace4b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:06.875897 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef2a28-1674-49c9-a097-7d9b383ace4b None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:06.877270 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef2a28-1674-49c9-a097-7d9b383ace4b None admin] RBAC: Adding query filter params (name=member) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:06.878835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef2a28-1674-49c9-a097-7d9b383ace4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:06.880615 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef2a28-1674-49c9-a097-7d9b383ace4b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:06.903074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 126/262] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:06.910450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef2a28-1674-49c9-a097-7d9b383ace4b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:07.077190 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4729b3-fcbe-4e9c-9030-9aac752cb085 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:07.129258 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b7a24-23da-4e5d-aa03-57aaa4542964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:07.130712 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b7a24-23da-4e5d-aa03-57aaa4542964 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:07.131163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b7a24-23da-4e5d-aa03-57aaa4542964 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:07.131608 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b7a24-23da-4e5d-aa03-57aaa4542964 None admin] PATH_INFO: `/v3/users/3d7e74a11b4447eebedce0b34d4c2f7f` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:07.133548 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b7a24-23da-4e5d-aa03-57aaa4542964 None admin] RBAC: Authorizing `identity:get_user(user_id=3d7e74a11b4447eebedce0b34d4c2f7f)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:07.135051 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b7a24-23da-4e5d-aa03-57aaa4542964 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:07.136929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 137/263] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:47:06 2022] GET /identity/v3/users/3d7e74a11b4447eebedce0b34d4c2f7f => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:07.142160 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b7a24-23da-4e5d-aa03-57aaa4542964 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:07.165577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef2a28-1674-49c9-a097-7d9b383ace4b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:07.231331 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc1ce2-fd47-42c1-90fc-fe076b88a923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:07.232217 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1ce2-fd47-42c1-90fc-fe076b88a923 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:07.232495 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1ce2-fd47-42c1-90fc-fe076b88a923 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:07.232768 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1ce2-fd47-42c1-90fc-fe076b88a923 None admin] PATH_INFO: `/v3/users/6ae0b6b8c8de4ecea7cf451f6c0fbe3e` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:07.233995 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc1ce2-fd47-42c1-90fc-fe076b88a923 None admin] RBAC: Authorizing `identity:get_user(user_id=6ae0b6b8c8de4ecea7cf451f6c0fbe3e)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:07.235444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc1ce2-fd47-42c1-90fc-fe076b88a923 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:07.237095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 127/264] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:47:06 2022] GET /identity/v3/users/6ae0b6b8c8de4ecea7cf451f6c0fbe3e => generated 297 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:07.242850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc1ce2-fd47-42c1-90fc-fe076b88a923 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:07.245826 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b7a24-23da-4e5d-aa03-57aaa4542964 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:07.295494 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cec42-fc05-4e6a-9934-fc9d64330c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:07.296449 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cec42-fc05-4e6a-9934-fc9d64330c47 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:07.296924 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cec42-fc05-4e6a-9934-fc9d64330c47 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:07.297412 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cec42-fc05-4e6a-9934-fc9d64330c47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:07.371091 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cec42-fc05-4e6a-9934-fc9d64330c47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:07.372932 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cec42-fc05-4e6a-9934-fc9d64330c47 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:07.464631 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc1ce2-fd47-42c1-90fc-fe076b88a923 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:07.471511 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 138/265] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 09:47:07.478746 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cec42-fc05-4e6a-9934-fc9d64330c47 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:07.503664 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1dc06-a122-4f5a-97bf-889bf5848db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:07.504535 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1dc06-a122-4f5a-97bf-889bf5848db4 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:07.504816 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1dc06-a122-4f5a-97bf-889bf5848db4 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:07.505087 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1dc06-a122-4f5a-97bf-889bf5848db4 None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:07.506439 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1dc06-a122-4f5a-97bf-889bf5848db4 None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:07.508705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1dc06-a122-4f5a-97bf-889bf5848db4 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:07.510852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 128/266] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:07 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:07.516643 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1dc06-a122-4f5a-97bf-889bf5848db4 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:07.656526 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cec42-fc05-4e6a-9934-fc9d64330c47 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:07.676793 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1dc06-a122-4f5a-97bf-889bf5848db4 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:07.724205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f36d75-e9c2-4ad7-a4be-0ce7882ed602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:07.725039 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f36d75-e9c2-4ad7-a4be-0ce7882ed602 None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:07.725314 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f36d75-e9c2-4ad7-a4be-0ce7882ed602 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:07.725583 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f36d75-e9c2-4ad7-a4be-0ce7882ed602 None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5/users/6ae0b6b8c8de4ecea7cf451f6c0fbe3e/roles/9e77c7f209fd4468bcf1b89bfef3c236` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:07.727948 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105408b-d742-492d-9e88-17b421733774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:07.729026 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105408b-d742-492d-9e88-17b421733774 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:07.729529 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105408b-d742-492d-9e88-17b421733774 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:07.730137 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105408b-d742-492d-9e88-17b421733774 None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:07.731596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105408b-d742-492d-9e88-17b421733774 None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:07.734505 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f36d75-e9c2-4ad7-a4be-0ce7882ed602 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a5cae0345914eccba509f41e0ddf7a5, user_id=6ae0b6b8c8de4ecea7cf451f6c0fbe3e, role_id=9e77c7f209fd4468bcf1b89bfef3c236)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:07.735942 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f36d75-e9c2-4ad7-a4be-0ce7882ed602 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:07.736935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105408b-d742-492d-9e88-17b421733774 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:07.738862 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 139/267] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:07 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:07.746438 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105408b-d742-492d-9e88-17b421733774 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:07.763494 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 129/268] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:47:07 2022] PUT /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5/users/6ae0b6b8c8de4ecea7cf451f6c0fbe3e/roles/9e77c7f209fd4468bcf1b89bfef3c236 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:47:07.883498 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105408b-d742-492d-9e88-17b421733774 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:07.935483 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9a613-3d34-4000-abaa-de0e6ad586b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:07.936145 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9a613-3d34-4000-abaa-de0e6ad586b4 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:07.936417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9a613-3d34-4000-abaa-de0e6ad586b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:07.936683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9a613-3d34-4000-abaa-de0e6ad586b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:07.937522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9a613-3d34-4000-abaa-de0e6ad586b4 None admin] RBAC: Adding query filter params (role.id=cb8032f764644c90a3dc0cb396434d67, scope.project.id=8a5cae0345914eccba509f41e0ddf7a5, user.id=3d7e74a11b4447eebedce0b34d4c2f7f) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:07.937866 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9a613-3d34-4000-abaa-de0e6ad586b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:07.939298 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9a613-3d34-4000-abaa-de0e6ad586b4 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:07.949385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 140/269] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:47:07 2022] GET /identity/v3/role_assignments?user.id=3d7e74a11b4447eebedce0b34d4c2f7f&scope.project.id=8a5cae0345914eccba509f41e0ddf7a5&role.id=cb8032f764644c90a3dc0cb396434d67 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:08.839397 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce50b8-5dc8-433f-bb45-ed18839d45d5 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:08.839919 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce50b8-5dc8-433f-bb45-ed18839d45d5 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:08.839919 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce50b8-5dc8-433f-bb45-ed18839d45d5 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:08.841307 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 130/270] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:08.846643 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b856e-d6a0-4188-93a0-bed3d36092ea None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:08.847444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b856e-d6a0-4188-93a0-bed3d36092ea None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:08.847906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b856e-d6a0-4188-93a0-bed3d36092ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:08.864774 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-f73b856e-d6a0-4188-93a0-bed3d36092ea None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:08.866331 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-f73b856e-d6a0-4188-93a0-bed3d36092ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:08.935840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 141/271] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:08.940055 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859ed69-3a2b-4356-8e86-0eab18c0d4d2 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:08.940344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859ed69-3a2b-4356-8e86-0eab18c0d4d2 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:08.940716 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859ed69-3a2b-4356-8e86-0eab18c0d4d2 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:08.942114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 131/272] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:08.947998 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27207044-aa58-4737-918d-a6d077613468 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:08.948287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27207044-aa58-4737-918d-a6d077613468 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:08.948559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27207044-aa58-4737-918d-a6d077613468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:08.961671 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859ed69-3a2b-4356-8e86-0eab18c0d4d2 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:08.966639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-27207044-aa58-4737-918d-a6d077613468 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:08.967814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-27207044-aa58-4737-918d-a6d077613468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:09.037598 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 142/273] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:47:09.061217 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27207044-aa58-4737-918d-a6d077613468 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:09.067808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859ed69-3a2b-4356-8e86-0eab18c0d4d2 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:09.102871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07e347-e1fa-45c8-b151-8bc7efe451c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:09.103732 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07e347-e1fa-45c8-b151-8bc7efe451c1 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:09.104226 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07e347-e1fa-45c8-b151-8bc7efe451c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:09.104691 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07e347-e1fa-45c8-b151-8bc7efe451c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:09.106080 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07e347-e1fa-45c8-b151-8bc7efe451c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:09.107768 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07e347-e1fa-45c8-b151-8bc7efe451c1 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:09.109940 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 132/274] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:09.115474 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07e347-e1fa-45c8-b151-8bc7efe451c1 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:09.163179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27207044-aa58-4737-918d-a6d077613468 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:09.197217 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38965141-362d-40c5-83c0-52238cfbf5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:09.198315 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38965141-362d-40c5-83c0-52238cfbf5f1 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:09.198736 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38965141-362d-40c5-83c0-52238cfbf5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:09.199187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38965141-362d-40c5-83c0-52238cfbf5f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:09.209374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38965141-362d-40c5-83c0-52238cfbf5f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:09.214091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07e347-e1fa-45c8-b151-8bc7efe451c1 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:09.217786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-38965141-362d-40c5-83c0-52238cfbf5f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:09.217786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:09.217786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:09.217786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:09.217786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:09.217786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:09.217786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:09.217786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:09.217786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:09.217786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:09.217786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:09.217786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:09.217786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:09.217786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:09.217786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:09.217786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:09.218748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:09.218748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:09.218748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:09.218748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:09.218748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:09.218748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:09.218748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:09.218748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:09.218748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:09.218748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:09.218748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:09.218748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:09.218748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:09.218748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:09.218748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:09.218748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:09.219523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:09.219523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:09.219523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:09.219523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:09.219523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:09.219523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:09.219523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:09.219523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:09.219523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:09.219523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:09.219523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:09.219523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:09.219523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 143/275] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:09.225083 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38965141-362d-40c5-83c0-52238cfbf5f1 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:09.250888 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39128343-cf2c-4c5a-bb1c-725a2ce6a452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:09.252047 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39128343-cf2c-4c5a-bb1c-725a2ce6a452 None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:09.252518 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39128343-cf2c-4c5a-bb1c-725a2ce6a452 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:09.252979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39128343-cf2c-4c5a-bb1c-725a2ce6a452 None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:09.253898 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39128343-cf2c-4c5a-bb1c-725a2ce6a452 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:09.255581 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39128343-cf2c-4c5a-bb1c-725a2ce6a452 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:09.285081 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 133/276] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:47:09 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:47:09.342714 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38965141-362d-40c5-83c0-52238cfbf5f1 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:09.380348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b6d9f-b9e3-4980-99bf-e1a877576d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:09.380951 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b6d9f-b9e3-4980-99bf-e1a877576d72 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:09.381233 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b6d9f-b9e3-4980-99bf-e1a877576d72 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:09.381511 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b6d9f-b9e3-4980-99bf-e1a877576d72 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:09.384444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b6d9f-b9e3-4980-99bf-e1a877576d72 None admin] RBAC: Adding query filter params (name=member) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:09.384756 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b6d9f-b9e3-4980-99bf-e1a877576d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:09.386198 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b6d9f-b9e3-4980-99bf-e1a877576d72 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:09.395421 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 144/277] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:09.401268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39128343-cf2c-4c5a-bb1c-725a2ce6a452 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:09.508838 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39128343-cf2c-4c5a-bb1c-725a2ce6a452 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:09.523112 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cd04a-5d94-4657-8963-60f9854cb5a3 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:09.523409 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cd04a-5d94-4657-8963-60f9854cb5a3 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:09.523773 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cd04a-5d94-4657-8963-60f9854cb5a3 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:09.525663 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 145/278] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:09.531071 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098b2e4-f010-401c-b1a5-d64c715acb78 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:09.531352 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098b2e4-f010-401c-b1a5-d64c715acb78 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:09.531626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098b2e4-f010-401c-b1a5-d64c715acb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:09.552035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b542e-6137-435b-888a-8d78c220c4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:09.552925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b542e-6137-435b-888a-8d78c220c4dd None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:09.553206 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b542e-6137-435b-888a-8d78c220c4dd None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:09.553476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b542e-6137-435b-888a-8d78c220c4dd None admin] PATH_INFO: `/v3/users/2379ec65b2414fb58078d08cdd5c5d3a` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:09.555214 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-c098b2e4-f010-401c-b1a5-d64c715acb78 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:09.557469 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-c098b2e4-f010-401c-b1a5-d64c715acb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:09.570646 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b542e-6137-435b-888a-8d78c220c4dd None admin] RBAC: Authorizing `identity:get_user(user_id=2379ec65b2414fb58078d08cdd5c5d3a)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:09.572277 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b542e-6137-435b-888a-8d78c220c4dd None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:09.574343 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 134/279] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:47:09 2022] GET /identity/v3/users/2379ec65b2414fb58078d08cdd5c5d3a => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:09.581073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b542e-6137-435b-888a-8d78c220c4dd None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:09.647194 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 146/280] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:09.671037 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098b2e4-f010-401c-b1a5-d64c715acb78 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:09.697500 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b542e-6137-435b-888a-8d78c220c4dd None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:09.738421 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d692d5-f76d-4031-ac65-f192cc71459f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:09.739097 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d692d5-f76d-4031-ac65-f192cc71459f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:09.739649 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d692d5-f76d-4031-ac65-f192cc71459f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:09.739922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d692d5-f76d-4031-ac65-f192cc71459f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:09.741013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d692d5-f76d-4031-ac65-f192cc71459f None admin] RBAC: Adding query filter params (role.id=9e77c7f209fd4468bcf1b89bfef3c236, user.id=2379ec65b2414fb58078d08cdd5c5d3a, scope.system=all) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:09.741322 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d692d5-f76d-4031-ac65-f192cc71459f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:09.742836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d692d5-f76d-4031-ac65-f192cc71459f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:09.748655 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 135/281] 10.222.0.55 () {56 vars in 1308 bytes} [Tue May 3 09:47:09 2022] GET /identity/v3/role_assignments?user.id=2379ec65b2414fb58078d08cdd5c5d3a&scope.system=all&role.id=9e77c7f209fd4468bcf1b89bfef3c236 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:09.785045 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098b2e4-f010-401c-b1a5-d64c715acb78 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:09.826225 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883d36a-12e0-4176-8743-786effff2b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:09.827393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883d36a-12e0-4176-8743-786effff2b6d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:09.827865 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883d36a-12e0-4176-8743-786effff2b6d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:09.828349 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883d36a-12e0-4176-8743-786effff2b6d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:09.844503 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883d36a-12e0-4176-8743-786effff2b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:09.852798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-6883d36a-12e0-4176-8743-786effff2b6d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:47:09.852798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:09.852798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:09.852798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:09.852798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:09.852798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:09.852798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:09.852798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:09.852798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:09.852798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:09.852798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:09.852798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:09.852798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:09.852798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:09.852798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:09.852798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:09.854156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:09.854156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:09.854156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:09.854156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:09.854156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:09.854156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:09.854156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:09.854156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:09.854156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:09.854156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:09.854156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:09.854156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:09.854156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:09.854156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:09.854156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:09.854156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:09.854957 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:09.854957 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:09.854957 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:09.854957 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:09.854957 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:09.854957 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:09.854957 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:09.854957 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:09.854957 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:09.854957 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:09.854957 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:47:09.854957 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:09.857719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 147/282] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:09.863880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d692d5-f76d-4031-ac65-f192cc71459f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:09.973429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d692d5-f76d-4031-ac65-f192cc71459f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:10.012104 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acbe8b-e7e7-471e-9577-1224d49ec32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:10.012768 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acbe8b-e7e7-471e-9577-1224d49ec32f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:10.013042 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acbe8b-e7e7-471e-9577-1224d49ec32f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:10.013308 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acbe8b-e7e7-471e-9577-1224d49ec32f None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:10.014081 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acbe8b-e7e7-471e-9577-1224d49ec32f None admin] RBAC: Adding query filter params (name=reader) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:10.014379 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acbe8b-e7e7-471e-9577-1224d49ec32f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:10.015744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acbe8b-e7e7-471e-9577-1224d49ec32f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:10.025073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 136/283] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:10.030685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883d36a-12e0-4176-8743-786effff2b6d None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:10.148833 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883d36a-12e0-4176-8743-786effff2b6d None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:10.181642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c2400-141a-48fe-9f6b-bed162e976bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:10.182579 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c2400-141a-48fe-9f6b-bed162e976bf None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:10.182854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c2400-141a-48fe-9f6b-bed162e976bf None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:10.183118 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c2400-141a-48fe-9f6b-bed162e976bf None admin] PATH_INFO: `/v3/users/ad2ee143dd4c4445b30fb0c88944b922` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:10.184306 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c2400-141a-48fe-9f6b-bed162e976bf None admin] RBAC: Authorizing `identity:get_user(user_id=ad2ee143dd4c4445b30fb0c88944b922)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:10.185759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c2400-141a-48fe-9f6b-bed162e976bf None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:10.187425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 148/284] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:47:10 2022] GET /identity/v3/users/ad2ee143dd4c4445b30fb0c88944b922 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:10.193585 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acbe8b-e7e7-471e-9577-1224d49ec32f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:10.316320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acbe8b-e7e7-471e-9577-1224d49ec32f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:10.360275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d744533-4ad6-4527-802c-960bc1c36f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:10.361153 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d744533-4ad6-4527-802c-960bc1c36f16 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:10.361425 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d744533-4ad6-4527-802c-960bc1c36f16 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:10.361842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d744533-4ad6-4527-802c-960bc1c36f16 None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:10.363004 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d744533-4ad6-4527-802c-960bc1c36f16 None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:10.364439 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d744533-4ad6-4527-802c-960bc1c36f16 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:10.367498 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 137/285] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:10 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:10.372520 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c2400-141a-48fe-9f6b-bed162e976bf None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:10.489508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c2400-141a-48fe-9f6b-bed162e976bf None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:10.496973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448dc0b3-2d00-4b93-8c4e-3ae9faa6d7db None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:10.496973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448dc0b3-2d00-4b93-8c4e-3ae9faa6d7db None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:10.496973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448dc0b3-2d00-4b93-8c4e-3ae9faa6d7db None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:10.496973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 138/286] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:10.502314 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e44b56-5b04-40e8-8471-92ddd40b96b6 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:10.502840 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e44b56-5b04-40e8-8471-92ddd40b96b6 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:10.503322 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e44b56-5b04-40e8-8471-92ddd40b96b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:10.534316 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-a7e44b56-5b04-40e8-8471-92ddd40b96b6 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:10.535486 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-a7e44b56-5b04-40e8-8471-92ddd40b96b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:10.541889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61462c89-dcbe-4612-af39-d3f78272aecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:10.542730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61462c89-dcbe-4612-af39-d3f78272aecd None admin] REQUEST_METHOD: `PUT` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:10.543003 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61462c89-dcbe-4612-af39-d3f78272aecd None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:10.543269 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61462c89-dcbe-4612-af39-d3f78272aecd None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5/users/ad2ee143dd4c4445b30fb0c88944b922/roles/2f97989a57b241f18734bf5df7ebe048` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:10.545747 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61462c89-dcbe-4612-af39-d3f78272aecd None admin] RBAC: Authorizing `identity:create_grant(project_id=8a5cae0345914eccba509f41e0ddf7a5, user_id=ad2ee143dd4c4445b30fb0c88944b922, role_id=2f97989a57b241f18734bf5df7ebe048)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:10.547207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61462c89-dcbe-4612-af39-d3f78272aecd None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:10.577974 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 149/287] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:47:10 2022] PUT /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5/users/ad2ee143dd4c4445b30fb0c88944b922/roles/2f97989a57b241f18734bf5df7ebe048 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:47:10.633260 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 139/288] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:47:10.660853 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61462c89-dcbe-4612-af39-d3f78272aecd None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:10.780420 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61462c89-dcbe-4612-af39-d3f78272aecd None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:10.815425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312d801-371b-40a3-ad88-310fbc65a444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:10.816159 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312d801-371b-40a3-ad88-310fbc65a444 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:10.816435 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312d801-371b-40a3-ad88-310fbc65a444 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:10.816705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312d801-371b-40a3-ad88-310fbc65a444 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:10.827660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312d801-371b-40a3-ad88-310fbc65a444 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:10.835295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-d312d801-371b-40a3-ad88-310fbc65a444 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:10.835295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:10.835295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:10.835295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:10.835295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:10.835295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:10.835295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:10.835295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:10.835295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:10.835295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:10.835295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:10.835295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:10.835295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:10.835295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:10.835295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:10.835295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:10.836222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:10.836222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:10.836222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:10.836222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:10.836222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:10.836222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:10.836222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:10.836222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:10.836222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:10.836222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:10.836222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:10.836222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:10.836222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:10.836222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:10.836222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:10.836222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:10.837360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:10.837360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:10.837360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:10.837360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:10.837360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:10.837360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:10.837360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:10.837360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:10.837360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:10.837360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:10.837360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:10.837360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:10.837360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 150/289] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:10.846936 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e44b56-5b04-40e8-8471-92ddd40b96b6 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:10.968166 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e44b56-5b04-40e8-8471-92ddd40b96b6 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:11.015872 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49350f63-b3d9-447e-94ef-fbc52c8e5c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:11.016905 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49350f63-b3d9-447e-94ef-fbc52c8e5c12 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:11.017377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49350f63-b3d9-447e-94ef-fbc52c8e5c12 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:11.017913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49350f63-b3d9-447e-94ef-fbc52c8e5c12 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:11.018864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49350f63-b3d9-447e-94ef-fbc52c8e5c12 None admin] RBAC: Adding query filter params (name=member) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:11.019375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49350f63-b3d9-447e-94ef-fbc52c8e5c12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:11.020922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49350f63-b3d9-447e-94ef-fbc52c8e5c12 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:11.032992 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 140/290] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:11.038736 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312d801-371b-40a3-ad88-310fbc65a444 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:11.165119 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312d801-371b-40a3-ad88-310fbc65a444 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:11.204761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca6a5c-60d5-413a-b0ea-582b50c098d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:11.205640 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca6a5c-60d5-413a-b0ea-582b50c098d1 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:11.206017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca6a5c-60d5-413a-b0ea-582b50c098d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:11.206291 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca6a5c-60d5-413a-b0ea-582b50c098d1 None admin] PATH_INFO: `/v3/users/6ae0b6b8c8de4ecea7cf451f6c0fbe3e` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:11.207486 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca6a5c-60d5-413a-b0ea-582b50c098d1 None admin] RBAC: Authorizing `identity:get_user(user_id=6ae0b6b8c8de4ecea7cf451f6c0fbe3e)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:11.208929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca6a5c-60d5-413a-b0ea-582b50c098d1 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:11.210587 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 151/291] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:47:11 2022] GET /identity/v3/users/6ae0b6b8c8de4ecea7cf451f6c0fbe3e => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:11.216166 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49350f63-b3d9-447e-94ef-fbc52c8e5c12 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:11.355756 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49350f63-b3d9-447e-94ef-fbc52c8e5c12 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:11.403179 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d2d82-b295-4a1f-bd9f-d1fd61a0a029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:11.404207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d2d82-b295-4a1f-bd9f-d1fd61a0a029 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:11.404634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d2d82-b295-4a1f-bd9f-d1fd61a0a029 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:11.405051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d2d82-b295-4a1f-bd9f-d1fd61a0a029 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:11.489147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d2d82-b295-4a1f-bd9f-d1fd61a0a029 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:11.490558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d2d82-b295-4a1f-bd9f-d1fd61a0a029 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:11.592337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 141/292] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:11.597680 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca6a5c-60d5-413a-b0ea-582b50c098d1 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:11.752298 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca6a5c-60d5-413a-b0ea-582b50c098d1 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:11.794738 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da3bd1-1376-43a8-8ae8-8a251bd1c56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:11.796014 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3bd1-1376-43a8-8ae8-8a251bd1c56c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:11.796490 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3bd1-1376-43a8-8ae8-8a251bd1c56c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:11.796951 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3bd1-1376-43a8-8ae8-8a251bd1c56c None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:11.798526 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da3bd1-1376-43a8-8ae8-8a251bd1c56c None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:11.800154 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da3bd1-1376-43a8-8ae8-8a251bd1c56c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:11.802108 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 152/293] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:11 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:11.809828 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d2d82-b295-4a1f-bd9f-d1fd61a0a029 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:11.945492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d2d82-b295-4a1f-bd9f-d1fd61a0a029 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:11.978301 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93635e20-0a29-46fe-88d0-6583b23b0afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:11.978959 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93635e20-0a29-46fe-88d0-6583b23b0afa None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:11.979226 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93635e20-0a29-46fe-88d0-6583b23b0afa None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:11.979497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93635e20-0a29-46fe-88d0-6583b23b0afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:11.980378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93635e20-0a29-46fe-88d0-6583b23b0afa None admin] RBAC: Adding query filter params (role.id=9e77c7f209fd4468bcf1b89bfef3c236, scope.project.id=8a5cae0345914eccba509f41e0ddf7a5, user.id=6ae0b6b8c8de4ecea7cf451f6c0fbe3e) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:11.980685 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93635e20-0a29-46fe-88d0-6583b23b0afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:11.982133 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93635e20-0a29-46fe-88d0-6583b23b0afa None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:11.988679 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 142/294] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:47:11 2022] GET /identity/v3/role_assignments?user.id=6ae0b6b8c8de4ecea7cf451f6c0fbe3e&scope.project.id=8a5cae0345914eccba509f41e0ddf7a5&role.id=9e77c7f209fd4468bcf1b89bfef3c236 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:12.259800 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60f97f-08ee-4282-b5ec-cbe87d8170f1 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:12.260677 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60f97f-08ee-4282-b5ec-cbe87d8170f1 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:12.261094 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60f97f-08ee-4282-b5ec-cbe87d8170f1 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:12.270896 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 153/295] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:12 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:12.277148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590417a-0a88-4d27-9edc-8bfa42fa3985 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:12.277511 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590417a-0a88-4d27-9edc-8bfa42fa3985 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:12.277874 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590417a-0a88-4d27-9edc-8bfa42fa3985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:12.302249 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-7590417a-0a88-4d27-9edc-8bfa42fa3985 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:12.303444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-7590417a-0a88-4d27-9edc-8bfa42fa3985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:12.380279 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 143/296] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:12.409011 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60f97f-08ee-4282-b5ec-cbe87d8170f1 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:12.512303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee822a0-b85a-4d96-b3a0-c355a1b69f5a None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:12.512496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee822a0-b85a-4d96-b3a0-c355a1b69f5a None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:12.513017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee822a0-b85a-4d96-b3a0-c355a1b69f5a None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:12.517280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 144/297] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:12.519567 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31e505-2687-404d-b927-e50e4ee6521e None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:12.520074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31e505-2687-404d-b927-e50e4ee6521e None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:12.520540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31e505-2687-404d-b927-e50e4ee6521e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:12.522726 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60f97f-08ee-4282-b5ec-cbe87d8170f1 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:12.541247 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-cb31e505-2687-404d-b927-e50e4ee6521e None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:12.548362 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-cb31e505-2687-404d-b927-e50e4ee6521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:12.559574 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c55085-fb3c-424b-8164-f3fcb1448476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:12.560383 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c55085-fb3c-424b-8164-f3fcb1448476 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:12.560662 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c55085-fb3c-424b-8164-f3fcb1448476 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:12.560941 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c55085-fb3c-424b-8164-f3fcb1448476 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:12.572203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c55085-fb3c-424b-8164-f3fcb1448476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:12.580017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-81c55085-fb3c-424b-8164-f3fcb1448476 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:47:12.580017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:12.580017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:12.580017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:12.580017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:12.580017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:12.580017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:12.580017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:12.580017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:12.580017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:12.580017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:12.580017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:12.580017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:12.580017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:12.580017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:12.580017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:12.580923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:12.580923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:12.580923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:12.580923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:12.580923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:12.580923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:12.580923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:12.580923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:12.580923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:12.580923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:12.580923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:12.580923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:12.580923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:12.580923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:12.580923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:12.580923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:12.581686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:12.581686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:12.581686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:12.581686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:12.581686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:12.581686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:12.581686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:12.581686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:12.581686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:12.581686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:12.581686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:47:12.581686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:12.581686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 154/298] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:12.588048 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c55085-fb3c-424b-8164-f3fcb1448476 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:12.632781 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 145/299] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:47:12.634233 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b27aa-0a98-4edc-a1b4-7b67f3b2d70c None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:12.634517 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b27aa-0a98-4edc-a1b4-7b67f3b2d70c None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:12.634791 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b27aa-0a98-4edc-a1b4-7b67f3b2d70c None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:12.636186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 146/300] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:12.641630 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6683-a77f-424c-9f05-24209c7466d9 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:12.641957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6683-a77f-424c-9f05-24209c7466d9 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:12.642440 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6683-a77f-424c-9f05-24209c7466d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:12.661145 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-345f6683-a77f-424c-9f05-24209c7466d9 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:12.662344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-345f6683-a77f-424c-9f05-24209c7466d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:12.694309 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c55085-fb3c-424b-8164-f3fcb1448476 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:12.726418 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac96f2-e9d9-4915-86c1-a7b73697924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:12.727497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac96f2-e9d9-4915-86c1-a7b73697924b None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:12.728079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac96f2-e9d9-4915-86c1-a7b73697924b None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:12.728683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac96f2-e9d9-4915-86c1-a7b73697924b None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:12.728786 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 147/301] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:12.730045 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac96f2-e9d9-4915-86c1-a7b73697924b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:12.730520 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac96f2-e9d9-4915-86c1-a7b73697924b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:12.732078 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac96f2-e9d9-4915-86c1-a7b73697924b None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:12.738738 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f6683-a77f-424c-9f05-24209c7466d9 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:12.743680 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 155/302] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:12.749132 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac96f2-e9d9-4915-86c1-a7b73697924b None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:12.838175 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f6683-a77f-424c-9f05-24209c7466d9 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:12.846857 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac96f2-e9d9-4915-86c1-a7b73697924b None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:12.870397 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcd1ef-04a2-472e-a6c9-75ecbfa13316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:12.871220 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcd1ef-04a2-472e-a6c9-75ecbfa13316 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:12.871476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcd1ef-04a2-472e-a6c9-75ecbfa13316 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:12.871748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcd1ef-04a2-472e-a6c9-75ecbfa13316 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:12.872909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcd1ef-04a2-472e-a6c9-75ecbfa13316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:12.874405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcd1ef-04a2-472e-a6c9-75ecbfa13316 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:12.876015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 148/303] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:12.876771 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcd1ef-04a2-472e-a6c9-75ecbfa13316 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:12.885100 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb8ea3-fc4d-4754-b95c-9d4e76f251d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:12.886013 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb8ea3-fc4d-4754-b95c-9d4e76f251d0 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:12.886294 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb8ea3-fc4d-4754-b95c-9d4e76f251d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:12.886564 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb8ea3-fc4d-4754-b95c-9d4e76f251d0 None admin] PATH_INFO: `/v3/users/b51919dbb5af4f32a942b92cc5b06c52` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:12.900490 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb8ea3-fc4d-4754-b95c-9d4e76f251d0 None admin] RBAC: Authorizing `identity:get_user(user_id=b51919dbb5af4f32a942b92cc5b06c52)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:12.902016 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb8ea3-fc4d-4754-b95c-9d4e76f251d0 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:12.908345 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 156/304] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:47:12 2022] GET /identity/v3/users/b51919dbb5af4f32a942b92cc5b06c52 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:12.908345 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb8ea3-fc4d-4754-b95c-9d4e76f251d0 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:12.972063 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcd1ef-04a2-472e-a6c9-75ecbfa13316 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:13.001438 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb8ea3-fc4d-4754-b95c-9d4e76f251d0 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:13.005182 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dcec2-d1ec-4deb-85ca-52f8112162a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:13.006013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dcec2-d1ec-4deb-85ca-52f8112162a4 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:13.006293 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dcec2-d1ec-4deb-85ca-52f8112162a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:13.006562 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dcec2-d1ec-4deb-85ca-52f8112162a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:13.017263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3dcec2-d1ec-4deb-85ca-52f8112162a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:13.025108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-ff3dcec2-d1ec-4deb-85ca-52f8112162a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:13.025108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:13.025108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:13.025108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:13.025108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:13.025108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:13.025108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:13.025108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:13.025108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:13.025108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:13.025108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:13.025108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:13.025108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:13.025108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:13.025108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:13.025108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:13.026035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:13.026035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:13.026035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:13.026035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:13.026035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:13.026035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:13.026035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:13.026035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:13.026035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:13.026035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:13.026035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:13.026035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:13.026035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:13.026035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:13.026035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:13.026035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:13.026819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:13.026819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:13.026819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:13.026819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:13.026819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:13.026819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:13.026819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:13.026819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:13.026819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:13.026819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:13.026819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:13.026819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:13.026819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 149/305] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:13.027479 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dcec2-d1ec-4deb-85ca-52f8112162a4 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:13.043075 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9edec-8af6-481a-a784-c3485dd17389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:13.043763 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9edec-8af6-481a-a784-c3485dd17389 None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:13.044043 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9edec-8af6-481a-a784-c3485dd17389 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:13.044323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9edec-8af6-481a-a784-c3485dd17389 None admin] PATH_INFO: `/v3/groups` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:13.045034 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9edec-8af6-481a-a784-c3485dd17389 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:13.046555 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9edec-8af6-481a-a784-c3485dd17389 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:13.062349 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 157/306] 10.222.0.55 () {60 vars in 1134 bytes} [Tue May 3 09:47:12 2022] POST /identity/v3/groups => generated 229 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:47:13.063586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9edec-8af6-481a-a784-c3485dd17389 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:13.132449 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dcec2-d1ec-4deb-85ca-52f8112162a4 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:13.168649 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fe4ba-32e6-47ad-b410-9bef594acb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:13.169489 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fe4ba-32e6-47ad-b410-9bef594acb61 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:13.169773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fe4ba-32e6-47ad-b410-9bef594acb61 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:13.170093 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fe4ba-32e6-47ad-b410-9bef594acb61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:13.171330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fe4ba-32e6-47ad-b410-9bef594acb61 None admin] RBAC: Adding query filter params (role.id=2f97989a57b241f18734bf5df7ebe048, user.id=b51919dbb5af4f32a942b92cc5b06c52, scope.system=all) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:13.171642 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fe4ba-32e6-47ad-b410-9bef594acb61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:13.173614 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fe4ba-32e6-47ad-b410-9bef594acb61 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:13.177205 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9edec-8af6-481a-a784-c3485dd17389 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:13.185103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 150/307] 10.222.0.55 () {56 vars in 1308 bytes} [Tue May 3 09:47:13 2022] GET /identity/v3/role_assignments?user.id=b51919dbb5af4f32a942b92cc5b06c52&scope.system=all&role.id=2f97989a57b241f18734bf5df7ebe048 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:13.217718 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2deac0-9515-4100-b399-abd5a00274fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:13.218444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2deac0-9515-4100-b399-abd5a00274fd None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:13.218723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2deac0-9515-4100-b399-abd5a00274fd None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:13.218995 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2deac0-9515-4100-b399-abd5a00274fd None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:13.219763 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2deac0-9515-4100-b399-abd5a00274fd None admin] RBAC: Adding query filter params (name=member) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:13.220066 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2deac0-9515-4100-b399-abd5a00274fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:13.221500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2deac0-9515-4100-b399-abd5a00274fd None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:13.231618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 158/308] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:13.236973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbc059-a7e7-4fab-bc7a-391681b2ed40 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:13.237290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbc059-a7e7-4fab-bc7a-391681b2ed40 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:13.237527 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbc059-a7e7-4fab-bc7a-391681b2ed40 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:13.238757 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2deac0-9515-4100-b399-abd5a00274fd None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:13.239203 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 151/309] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:13.245415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746925be-6eaf-446e-917f-e9805647f976 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:13.245749 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746925be-6eaf-446e-917f-e9805647f976 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:13.245996 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746925be-6eaf-446e-917f-e9805647f976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:13.263995 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-746925be-6eaf-446e-917f-e9805647f976 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:13.265205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-746925be-6eaf-446e-917f-e9805647f976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:13.347665 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 152/310] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:47:13.350997 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2deac0-9515-4100-b399-abd5a00274fd None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:13.371865 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746925be-6eaf-446e-917f-e9805647f976 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:13.387440 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5273a-0097-4dab-ac0b-e23fbe8b6d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:13.388254 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5273a-0097-4dab-ac0b-e23fbe8b6d58 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:13.388535 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5273a-0097-4dab-ac0b-e23fbe8b6d58 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:13.388808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5273a-0097-4dab-ac0b-e23fbe8b6d58 None admin] PATH_INFO: `/v3/users/2379ec65b2414fb58078d08cdd5c5d3a` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:13.390037 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5273a-0097-4dab-ac0b-e23fbe8b6d58 None admin] RBAC: Authorizing `identity:get_user(user_id=2379ec65b2414fb58078d08cdd5c5d3a)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:13.391479 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5273a-0097-4dab-ac0b-e23fbe8b6d58 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:13.393428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 159/311] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:47:13 2022] GET /identity/v3/users/2379ec65b2414fb58078d08cdd5c5d3a => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:13.399345 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5273a-0097-4dab-ac0b-e23fbe8b6d58 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:13.485185 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746925be-6eaf-446e-917f-e9805647f976 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:13.506864 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5273a-0097-4dab-ac0b-e23fbe8b6d58 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:13.527843 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68622ec-95a2-4b14-8d2b-d1b4ad0cf8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:13.529322 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68622ec-95a2-4b14-8d2b-d1b4ad0cf8fc None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:13.530025 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68622ec-95a2-4b14-8d2b-d1b4ad0cf8fc None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:13.530679 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68622ec-95a2-4b14-8d2b-d1b4ad0cf8fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:13.542607 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68622ec-95a2-4b14-8d2b-d1b4ad0cf8fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:13.544933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e32d86-384e-4b44-9614-92576c0ad8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:13.545821 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e32d86-384e-4b44-9614-92576c0ad8ed None admin] REQUEST_METHOD: `PUT` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:13.546193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e32d86-384e-4b44-9614-92576c0ad8ed None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:13.546468 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e32d86-384e-4b44-9614-92576c0ad8ed None admin] PATH_INFO: `/v3/system/users/2379ec65b2414fb58078d08cdd5c5d3a/roles/9e77c7f209fd4468bcf1b89bfef3c236` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:13.547965 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e32d86-384e-4b44-9614-92576c0ad8ed None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2379ec65b2414fb58078d08cdd5c5d3a, role_id=9e77c7f209fd4468bcf1b89bfef3c236)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:13.549339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e32d86-384e-4b44-9614-92576c0ad8ed None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:13.552287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-f68622ec-95a2-4b14-8d2b-d1b4ad0cf8fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:47:13.552287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:13.552287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:13.552287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:13.552287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:13.552287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:13.552287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:13.552287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:13.552287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:13.552287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:13.552287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:13.552287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:13.552287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:13.552287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:13.552287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:13.552287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:13.553158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:13.553158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:13.553158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:13.553158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:13.553158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:13.553158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:13.553158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:13.553158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:13.553158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:13.553158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:13.553158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:13.553158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:13.553158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:13.553158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:13.553158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:13.553158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:13.554428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:13.554428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:13.554428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:13.554428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:13.554428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:13.554428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:13.554428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:13.554428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:13.554428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:13.554428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:13.554428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:47:13.554428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:13.557874 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 153/312] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:13.562317 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68622ec-95a2-4b14-8d2b-d1b4ad0cf8fc None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:13.563719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 160/313] 10.222.0.55 () {58 vars in 1334 bytes} [Tue May 3 09:47:13 2022] PUT /identity/v3/system/users/2379ec65b2414fb58078d08cdd5c5d3a/roles/9e77c7f209fd4468bcf1b89bfef3c236 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:47:13.678787 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68622ec-95a2-4b14-8d2b-d1b4ad0cf8fc None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:13.714474 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0b409-fe4e-47d0-9071-67332e0399bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:13.715163 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0b409-fe4e-47d0-9071-67332e0399bf None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:13.715443 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0b409-fe4e-47d0-9071-67332e0399bf None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:13.715721 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0b409-fe4e-47d0-9071-67332e0399bf None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:13.716482 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0b409-fe4e-47d0-9071-67332e0399bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:13.716789 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0b409-fe4e-47d0-9071-67332e0399bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:13.718212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0b409-fe4e-47d0-9071-67332e0399bf None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:13.727894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 154/314] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:13.733708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e32d86-384e-4b44-9614-92576c0ad8ed None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:13.833414 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e32d86-384e-4b44-9614-92576c0ad8ed None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:13.866958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c177ff-5480-4b8b-90ae-6599f0ab9744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:13.868196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c177ff-5480-4b8b-90ae-6599f0ab9744 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:13.868580 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c177ff-5480-4b8b-90ae-6599f0ab9744 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:13.868859 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c177ff-5480-4b8b-90ae-6599f0ab9744 None admin] PATH_INFO: `/v3/users/ad2ee143dd4c4445b30fb0c88944b922` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:13.870100 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c177ff-5480-4b8b-90ae-6599f0ab9744 None admin] RBAC: Authorizing `identity:get_user(user_id=ad2ee143dd4c4445b30fb0c88944b922)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:13.871612 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c177ff-5480-4b8b-90ae-6599f0ab9744 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:13.873347 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 161/315] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:47:13 2022] GET /identity/v3/users/ad2ee143dd4c4445b30fb0c88944b922 => generated 297 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:13.878732 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0b409-fe4e-47d0-9071-67332e0399bf None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:13.980330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0b409-fe4e-47d0-9071-67332e0399bf None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:14.014455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c3764-4459-453d-b752-86033a7737a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:14.015214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c3764-4459-453d-b752-86033a7737a0 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:14.015365 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c3764-4459-453d-b752-86033a7737a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:14.015635 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c3764-4459-453d-b752-86033a7737a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:14.082108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c3764-4459-453d-b752-86033a7737a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:14.083686 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c3764-4459-453d-b752-86033a7737a0 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:14.179627 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 155/316] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 09:47:14.186936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c177ff-5480-4b8b-90ae-6599f0ab9744 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:14.288735 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c177ff-5480-4b8b-90ae-6599f0ab9744 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:14.324398 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9f677-b6d3-4c1e-890d-596723c1777f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:14.325293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9f677-b6d3-4c1e-890d-596723c1777f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:14.325567 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9f677-b6d3-4c1e-890d-596723c1777f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:14.325871 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9f677-b6d3-4c1e-890d-596723c1777f None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:14.327100 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9f677-b6d3-4c1e-890d-596723c1777f None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:14.328567 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9f677-b6d3-4c1e-890d-596723c1777f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:14.330303 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 162/317] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:14 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:14.336240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c3764-4459-453d-b752-86033a7737a0 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:14.434643 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c3764-4459-453d-b752-86033a7737a0 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:14.467013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a290c-62d5-41a3-b142-06996d87891e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:14.467670 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a290c-62d5-41a3-b142-06996d87891e None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:14.467957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a290c-62d5-41a3-b142-06996d87891e None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:14.468235 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a290c-62d5-41a3-b142-06996d87891e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:14.469074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a290c-62d5-41a3-b142-06996d87891e None admin] RBAC: Adding query filter params (role.id=2f97989a57b241f18734bf5df7ebe048, scope.project.id=8a5cae0345914eccba509f41e0ddf7a5, user.id=ad2ee143dd4c4445b30fb0c88944b922) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:14.469384 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a290c-62d5-41a3-b142-06996d87891e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:14.470912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a290c-62d5-41a3-b142-06996d87891e None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:14.476932 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 156/318] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:47:14 2022] GET /identity/v3/role_assignments?user.id=ad2ee143dd4c4445b30fb0c88944b922&scope.project.id=8a5cae0345914eccba509f41e0ddf7a5&role.id=2f97989a57b241f18734bf5df7ebe048 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:15.443855 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01aff6-144e-4f46-b1a9-cbf77a808bab None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:15.444384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01aff6-144e-4f46-b1a9-cbf77a808bab None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:15.444384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01aff6-144e-4f46-b1a9-cbf77a808bab None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:15.446140 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 163/319] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:15.451378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a181b-f195-46d5-8632-8e094d86f8a4 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:15.451802 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a181b-f195-46d5-8632-8e094d86f8a4 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:15.451972 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a181b-f195-46d5-8632-8e094d86f8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:15.469115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-0e8a181b-f195-46d5-8632-8e094d86f8a4 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:15.470320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-0e8a181b-f195-46d5-8632-8e094d86f8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:15.477391 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400f61-47d3-4738-9ce1-a204318328fa None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:15.477762 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400f61-47d3-4738-9ce1-a204318328fa None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:15.478090 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400f61-47d3-4738-9ce1-a204318328fa None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:15.479457 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 164/320] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:47:15.484795 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd5570-ba3f-4e3c-9ef2-71626feb8d9c None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:15.485075 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd5570-ba3f-4e3c-9ef2-71626feb8d9c None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:15.485342 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd5570-ba3f-4e3c-9ef2-71626feb8d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:15.502393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-5ecd5570-ba3f-4e3c-9ef2-71626feb8d9c None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:15.503549 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-5ecd5570-ba3f-4e3c-9ef2-71626feb8d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:15.538068 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 157/321] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:15.560255 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a181b-f195-46d5-8632-8e094d86f8a4 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:15.574541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 165/322] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:15.596387 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd5570-ba3f-4e3c-9ef2-71626feb8d9c None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:15.663409 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a181b-f195-46d5-8632-8e094d86f8a4 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:15.695488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd5570-ba3f-4e3c-9ef2-71626feb8d9c None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:15.696946 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8797b-aa48-4b82-800d-8e914a100408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:15.697745 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8797b-aa48-4b82-800d-8e914a100408 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:15.698088 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8797b-aa48-4b82-800d-8e914a100408 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:15.698353 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8797b-aa48-4b82-800d-8e914a100408 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:15.699507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8797b-aa48-4b82-800d-8e914a100408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:15.700943 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8797b-aa48-4b82-800d-8e914a100408 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:15.702745 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 158/323] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:15.707926 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8797b-aa48-4b82-800d-8e914a100408 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:15.731869 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c4142-149b-49ae-8953-2b3cdcefc491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:15.732675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c4142-149b-49ae-8953-2b3cdcefc491 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:15.732957 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c4142-149b-49ae-8953-2b3cdcefc491 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:15.733229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c4142-149b-49ae-8953-2b3cdcefc491 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:15.743950 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c4142-149b-49ae-8953-2b3cdcefc491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:15.751731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-322c4142-149b-49ae-8953-2b3cdcefc491 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:47:15.751731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:15.751731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:15.751731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:15.751731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:15.751731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:15.751731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:15.751731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:15.751731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:15.751731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:15.751731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:15.751731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:15.751731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:15.751731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:15.751731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:15.751731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:15.752767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:15.752767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:15.752767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:15.752767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:15.752767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:15.752767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:15.752767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:15.752767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:15.752767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:15.752767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:15.752767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:15.752767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:15.752767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:15.752767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:15.752767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:15.752767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:15.753577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:15.753577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:15.753577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:15.753577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:15.753577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:15.753577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:15.753577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:15.753577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:15.753577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:15.753577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:15.753577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:47:15.753577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:15.753577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 166/324] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:15.759079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c4142-149b-49ae-8953-2b3cdcefc491 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:15.814950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8797b-aa48-4b82-800d-8e914a100408 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:15.847344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f059df6-df28-4230-a756-7384a6ecdced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:15.848006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f059df6-df28-4230-a756-7384a6ecdced None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:15.848282 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f059df6-df28-4230-a756-7384a6ecdced None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:15.848551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f059df6-df28-4230-a756-7384a6ecdced None admin] PATH_INFO: `/v3/groups` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:15.849227 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f059df6-df28-4230-a756-7384a6ecdced None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:15.850689 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f059df6-df28-4230-a756-7384a6ecdced None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:15.854376 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c4142-149b-49ae-8953-2b3cdcefc491 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:15.865018 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 159/325] 10.222.0.55 () {60 vars in 1134 bytes} [Tue May 3 09:47:15 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:47:15.866490 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9a32b-3244-4523-8383-935aa4642f16 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:15.866771 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9a32b-3244-4523-8383-935aa4642f16 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:15.867039 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9a32b-3244-4523-8383-935aa4642f16 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:15.868468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 160/326] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:15.874228 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a3564-370c-4cef-8b0b-f893fd50ad88 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:15.874514 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a3564-370c-4cef-8b0b-f893fd50ad88 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:15.874779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a3564-370c-4cef-8b0b-f893fd50ad88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:15.891164 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ea2cb-0774-459f-bb1a-f0e8753ca853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:15.891939 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea2cb-0774-459f-bb1a-f0e8753ca853 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:15.892248 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea2cb-0774-459f-bb1a-f0e8753ca853 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:15.892536 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea2cb-0774-459f-bb1a-f0e8753ca853 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:15.893382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ea2cb-0774-459f-bb1a-f0e8753ca853 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:15.893599 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-5b3a3564-370c-4cef-8b0b-f893fd50ad88 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:15.893710 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ea2cb-0774-459f-bb1a-f0e8753ca853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:15.894856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-5b3a3564-370c-4cef-8b0b-f893fd50ad88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:15.895140 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ea2cb-0774-459f-bb1a-f0e8753ca853 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:15.905330 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 167/327] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:15.911034 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ea2cb-0774-459f-bb1a-f0e8753ca853 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:15.966943 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 161/328] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:15.990496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a3564-370c-4cef-8b0b-f893fd50ad88 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:16.014772 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ea2cb-0774-459f-bb1a-f0e8753ca853 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:16.048268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48f3b5-7f32-4832-b5aa-f9cd26ee0d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:16.049148 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48f3b5-7f32-4832-b5aa-f9cd26ee0d11 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:16.049427 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48f3b5-7f32-4832-b5aa-f9cd26ee0d11 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:16.049694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48f3b5-7f32-4832-b5aa-f9cd26ee0d11 None admin] PATH_INFO: `/v3/users/b51919dbb5af4f32a942b92cc5b06c52` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:16.050912 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48f3b5-7f32-4832-b5aa-f9cd26ee0d11 None admin] RBAC: Authorizing `identity:get_user(user_id=b51919dbb5af4f32a942b92cc5b06c52)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:16.052365 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48f3b5-7f32-4832-b5aa-f9cd26ee0d11 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:16.054176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 168/329] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:47:15 2022] GET /identity/v3/users/b51919dbb5af4f32a942b92cc5b06c52 => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:16.059608 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48f3b5-7f32-4832-b5aa-f9cd26ee0d11 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:16.092529 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a3564-370c-4cef-8b0b-f893fd50ad88 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:16.128783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83835872-0061-4470-b47f-b7b4234c1b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:16.129849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83835872-0061-4470-b47f-b7b4234c1b0e None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:16.130286 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83835872-0061-4470-b47f-b7b4234c1b0e None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:16.130681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83835872-0061-4470-b47f-b7b4234c1b0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:16.145590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83835872-0061-4470-b47f-b7b4234c1b0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:16.152808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-83835872-0061-4470-b47f-b7b4234c1b0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:16.152808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:16.152808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:16.152808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:16.152808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:16.152808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:16.152808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:16.152808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:16.152808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:16.152808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:16.152808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:16.152808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:16.152808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:16.152808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:16.152808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:16.152808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:16.153717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:16.153717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:16.153717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:16.153717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:16.153717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:16.153717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:16.153717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:16.153717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:16.153717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:16.153717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:16.153717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:16.153717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:16.153717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:16.153717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:16.153717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:16.153717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:16.154547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:16.154547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:16.154547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:16.154547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:16.154547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:16.154547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:16.154547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:16.154547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:16.154547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:16.154547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:16.154547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:16.154547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:16.154547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 162/330] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:16.160215 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83835872-0061-4470-b47f-b7b4234c1b0e None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:16.181162 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48f3b5-7f32-4832-b5aa-f9cd26ee0d11 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:16.222951 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d14f9-9de5-4e18-888a-6d03ed819bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:16.224502 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d14f9-9de5-4e18-888a-6d03ed819bc5 None admin] REQUEST_METHOD: `PUT` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:16.225082 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d14f9-9de5-4e18-888a-6d03ed819bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:16.225603 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d14f9-9de5-4e18-888a-6d03ed819bc5 None admin] PATH_INFO: `/v3/system/users/b51919dbb5af4f32a942b92cc5b06c52/roles/2f97989a57b241f18734bf5df7ebe048` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:16.227639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d14f9-9de5-4e18-888a-6d03ed819bc5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b51919dbb5af4f32a942b92cc5b06c52, role_id=2f97989a57b241f18734bf5df7ebe048)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:16.229118 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d14f9-9de5-4e18-888a-6d03ed819bc5 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:16.239465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 169/331] 10.222.0.55 () {58 vars in 1334 bytes} [Tue May 3 09:47:16 2022] PUT /identity/v3/system/users/b51919dbb5af4f32a942b92cc5b06c52/roles/2f97989a57b241f18734bf5df7ebe048 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:47:16.290794 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83835872-0061-4470-b47f-b7b4234c1b0e None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:16.329046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51177e-f8fb-4ff2-b933-02d48d53d635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:16.329875 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51177e-f8fb-4ff2-b933-02d48d53d635 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:16.330186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51177e-f8fb-4ff2-b933-02d48d53d635 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:16.330499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51177e-f8fb-4ff2-b933-02d48d53d635 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:16.331474 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51177e-f8fb-4ff2-b933-02d48d53d635 None admin] RBAC: Adding query filter params (name=member) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:16.331935 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51177e-f8fb-4ff2-b933-02d48d53d635 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:16.334564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51177e-f8fb-4ff2-b933-02d48d53d635 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:16.347334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 163/332] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:16.352514 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d14f9-9de5-4e18-888a-6d03ed819bc5 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:16.466068 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d14f9-9de5-4e18-888a-6d03ed819bc5 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:16.503863 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324acdfc-3e94-4a21-a962-e54e79735d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:16.505109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324acdfc-3e94-4a21-a962-e54e79735d1c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:16.505594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324acdfc-3e94-4a21-a962-e54e79735d1c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:16.506094 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324acdfc-3e94-4a21-a962-e54e79735d1c None admin] PATH_INFO: `/v3/users/2379ec65b2414fb58078d08cdd5c5d3a` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:16.508161 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324acdfc-3e94-4a21-a962-e54e79735d1c None admin] RBAC: Authorizing `identity:get_user(user_id=2379ec65b2414fb58078d08cdd5c5d3a)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:16.510041 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324acdfc-3e94-4a21-a962-e54e79735d1c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:16.512336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 170/333] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:47:16 2022] GET /identity/v3/users/2379ec65b2414fb58078d08cdd5c5d3a => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:16.520748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51177e-f8fb-4ff2-b933-02d48d53d635 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:16.631588 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51177e-f8fb-4ff2-b933-02d48d53d635 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:16.672123 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517c3a2-158f-4c14-8adf-2304aaaecfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:16.672783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517c3a2-158f-4c14-8adf-2304aaaecfbc None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:16.673059 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517c3a2-158f-4c14-8adf-2304aaaecfbc None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:16.673332 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517c3a2-158f-4c14-8adf-2304aaaecfbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:16.674223 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517c3a2-158f-4c14-8adf-2304aaaecfbc None admin] RBAC: Adding query filter params (role.id=9e77c7f209fd4468bcf1b89bfef3c236, user.id=2379ec65b2414fb58078d08cdd5c5d3a, scope.system=all) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:16.674530 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517c3a2-158f-4c14-8adf-2304aaaecfbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:16.676011 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517c3a2-158f-4c14-8adf-2304aaaecfbc None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:16.688284 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 164/334] 10.222.0.55 () {56 vars in 1308 bytes} [Tue May 3 09:47:16 2022] GET /identity/v3/role_assignments?user.id=2379ec65b2414fb58078d08cdd5c5d3a&scope.system=all&role.id=9e77c7f209fd4468bcf1b89bfef3c236 => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:18.698232 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df778f01-2ab7-418e-be70-98ae675dd01d None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:18.699202 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df778f01-2ab7-418e-be70-98ae675dd01d None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:18.699704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df778f01-2ab7-418e-be70-98ae675dd01d None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:18.701575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 171/335] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:18.706641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4960d-ec09-4f9e-83a3-d94af6b227a4 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:18.707466 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4960d-ec09-4f9e-83a3-d94af6b227a4 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:18.707931 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4960d-ec09-4f9e-83a3-d94af6b227a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:18.725651 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-3ad4960d-ec09-4f9e-83a3-d94af6b227a4 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:18.727268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-3ad4960d-ec09-4f9e-83a3-d94af6b227a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:18.784964 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfafcc7-08bb-4668-bfa1-d7488602f2de None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:18.785296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfafcc7-08bb-4668-bfa1-d7488602f2de None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:18.785510 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfafcc7-08bb-4668-bfa1-d7488602f2de None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:18.788079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 172/336] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:18.793814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce648c-126e-46b3-a2bf-4492a5c2afc9 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:18.793814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce648c-126e-46b3-a2bf-4492a5c2afc9 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:18.794058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce648c-126e-46b3-a2bf-4492a5c2afc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:18.812617 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 165/337] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:18.824049 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-f2ce648c-126e-46b3-a2bf-4492a5c2afc9 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:18.825622 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-f2ce648c-126e-46b3-a2bf-4492a5c2afc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:18.851808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4960d-ec09-4f9e-83a3-d94af6b227a4 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:18.947582 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 173/338] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:47:18.986779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4960d-ec09-4f9e-83a3-d94af6b227a4 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:18.991691 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce648c-126e-46b3-a2bf-4492a5c2afc9 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:19.024940 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa97157-2687-4a27-ace7-7f790e0324f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:19.026137 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa97157-2687-4a27-ace7-7f790e0324f9 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:19.026635 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa97157-2687-4a27-ace7-7f790e0324f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:19.027099 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa97157-2687-4a27-ace7-7f790e0324f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:19.038431 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa97157-2687-4a27-ace7-7f790e0324f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:19.046536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-ffa97157-2687-4a27-ace7-7f790e0324f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:19.046536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:19.046536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:19.046536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:19.046536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:19.046536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:19.046536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:19.046536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:19.046536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:19.046536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:19.046536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:19.046536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:19.046536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:19.046536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:19.046536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:19.046536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:19.047430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:19.047430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:19.047430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:19.047430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:19.047430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:19.047430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:19.047430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:19.047430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:19.047430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:19.047430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:19.047430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:19.047430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:19.047430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:19.047430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:19.047430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:19.047430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:19.048200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:19.048200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:19.048200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:19.048200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:19.048200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:19.048200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:19.048200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:19.048200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:19.048200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:19.048200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:19.048200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:19.048200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:19.051059 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 166/339] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:19.056797 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa97157-2687-4a27-ace7-7f790e0324f9 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:19.173509 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce648c-126e-46b3-a2bf-4492a5c2afc9 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:19.220697 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ef074-b848-4834-afc6-13458aa35d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:19.221885 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ef074-b848-4834-afc6-13458aa35d29 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:19.222491 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ef074-b848-4834-afc6-13458aa35d29 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:19.222950 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ef074-b848-4834-afc6-13458aa35d29 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:19.236873 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ef074-b848-4834-afc6-13458aa35d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:19.246267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-be8ef074-b848-4834-afc6-13458aa35d29 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:47:19.246267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:19.246267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:19.246267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:19.246267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:19.246267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:19.246267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:19.246267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:19.246267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:19.246267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:19.246267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:19.246267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:19.246267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:19.246267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:19.246267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:19.246267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:19.247187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:19.247187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:19.247187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:19.247187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:19.247187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:19.247187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:19.247187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:19.247187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:19.247187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:19.247187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:19.247187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:19.247187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:19.247187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:19.247187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:19.247187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:19.247187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:19.247952 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:19.247952 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:19.247952 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:19.247952 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:19.247952 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:19.247952 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:19.247952 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:19.247952 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:19.247952 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:19.247952 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:19.247952 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 09:47:19.247952 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:19.255810 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 174/340] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:19.257381 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bd1c9-e3a2-44ac-8b73-a94fe91a353d None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:19.258397 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bd1c9-e3a2-44ac-8b73-a94fe91a353d None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:19.259068 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bd1c9-e3a2-44ac-8b73-a94fe91a353d None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:19.261179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 175/341] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:19.262288 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496bd1c9-e3a2-44ac-8b73-a94fe91a353d None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:19.278409 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa97157-2687-4a27-ace7-7f790e0324f9 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:19.340021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a40bcb-8d0b-4513-b8cc-1227b471de42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:19.340714 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a40bcb-8d0b-4513-b8cc-1227b471de42 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:19.340995 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a40bcb-8d0b-4513-b8cc-1227b471de42 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:19.341569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a40bcb-8d0b-4513-b8cc-1227b471de42 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:19.342063 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a40bcb-8d0b-4513-b8cc-1227b471de42 None admin] RBAC: Adding query filter params (name=member) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:19.342370 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a40bcb-8d0b-4513-b8cc-1227b471de42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:19.343797 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a40bcb-8d0b-4513-b8cc-1227b471de42 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:19.358296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 167/342] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:19.359671 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ffec9-718a-496d-8a9b-5d12a7e40cd6 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:19.359957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ffec9-718a-496d-8a9b-5d12a7e40cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:19.360230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ffec9-718a-496d-8a9b-5d12a7e40cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:19.386479 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496bd1c9-e3a2-44ac-8b73-a94fe91a353d None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:19.394811 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-ca9ffec9-718a-496d-8a9b-5d12a7e40cd6 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:19.395998 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-ca9ffec9-718a-496d-8a9b-5d12a7e40cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:19.420887 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcaedd3-841b-485f-bfa4-365cfb297eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:19.421948 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaedd3-841b-485f-bfa4-365cfb297eb1 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:19.422421 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaedd3-841b-485f-bfa4-365cfb297eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:19.422909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaedd3-841b-485f-bfa4-365cfb297eb1 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:19.423845 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcaedd3-841b-485f-bfa4-365cfb297eb1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:19.424338 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcaedd3-841b-485f-bfa4-365cfb297eb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:19.425924 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcaedd3-841b-485f-bfa4-365cfb297eb1 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:19.435570 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 176/343] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:19.436702 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcaedd3-841b-485f-bfa4-365cfb297eb1 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:19.516570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 168/344] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:19.517815 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ffec9-718a-496d-8a9b-5d12a7e40cd6 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:19.598291 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcaedd3-841b-485f-bfa4-365cfb297eb1 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:19.647292 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463b2f4-8c59-49fa-869f-811d72fbeaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:19.647957 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463b2f4-8c59-49fa-869f-811d72fbeaa4 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:19.648236 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463b2f4-8c59-49fa-869f-811d72fbeaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:19.648674 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463b2f4-8c59-49fa-869f-811d72fbeaa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:19.677285 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ffec9-718a-496d-8a9b-5d12a7e40cd6 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:19.720205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeb976-75e7-4a2e-abde-ab7e213d1dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:19.721034 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeb976-75e7-4a2e-abde-ab7e213d1dfd None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:19.721313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeb976-75e7-4a2e-abde-ab7e213d1dfd None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:19.721651 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeb976-75e7-4a2e-abde-ab7e213d1dfd None admin] PATH_INFO: `/v3/users/b51919dbb5af4f32a942b92cc5b06c52` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:19.723147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eeb976-75e7-4a2e-abde-ab7e213d1dfd None admin] RBAC: Authorizing `identity:get_user(user_id=b51919dbb5af4f32a942b92cc5b06c52)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:19.724583 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eeb976-75e7-4a2e-abde-ab7e213d1dfd None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:19.726577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 169/345] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:47:19 2022] GET /identity/v3/users/b51919dbb5af4f32a942b92cc5b06c52 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:19.732391 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeb976-75e7-4a2e-abde-ab7e213d1dfd None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:19.738546 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463b2f4-8c59-49fa-869f-811d72fbeaa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:19.740654 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463b2f4-8c59-49fa-869f-811d72fbeaa4 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:19.841777 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeb976-75e7-4a2e-abde-ab7e213d1dfd None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:19.845776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 177/346] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:19.847331 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59720bde-9658-4744-bdfa-ac46ef4fbc93 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:19.847826 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59720bde-9658-4744-bdfa-ac46ef4fbc93 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:19.848296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59720bde-9658-4744-bdfa-ac46ef4fbc93 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:19.849757 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 178/347] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:19.850909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59720bde-9658-4744-bdfa-ac46ef4fbc93 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:19.878959 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3f543-1a77-4682-9c5e-29e27fe75848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:19.879544 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3f543-1a77-4682-9c5e-29e27fe75848 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:19.879825 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3f543-1a77-4682-9c5e-29e27fe75848 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:19.880100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3f543-1a77-4682-9c5e-29e27fe75848 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:19.892454 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3f543-1a77-4682-9c5e-29e27fe75848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:19.900912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-64d3f543-1a77-4682-9c5e-29e27fe75848 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:19.900912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:19.900912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:19.900912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:19.900912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:19.900912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:19.900912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:19.900912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:19.900912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:19.900912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:19.900912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:19.900912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:19.900912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:19.900912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:19.900912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:19.900912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:19.902263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:19.902263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:19.902263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:19.902263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:19.902263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:19.902263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:19.902263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:19.902263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:19.902263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:19.902263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:19.902263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:19.902263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:19.902263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:19.902263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:19.902263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:19.902263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:19.903109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:19.903109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:19.903109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:19.903109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:19.903109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:19.903109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:19.903109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:19.903109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:19.903109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:19.903109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:19.903109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:19.903109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:19.903109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 170/348] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:47:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:19.903858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3f543-1a77-4682-9c5e-29e27fe75848 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:19.957187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59720bde-9658-4744-bdfa-ac46ef4fbc93 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:19.991841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29c3ae-43b2-4e08-b44d-92dbc89b9714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:19.992975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29c3ae-43b2-4e08-b44d-92dbc89b9714 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:19.993515 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29c3ae-43b2-4e08-b44d-92dbc89b9714 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:19.994012 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29c3ae-43b2-4e08-b44d-92dbc89b9714 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:19.995052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29c3ae-43b2-4e08-b44d-92dbc89b9714 None admin] RBAC: Adding query filter params (role.id=2f97989a57b241f18734bf5df7ebe048, user.id=b51919dbb5af4f32a942b92cc5b06c52, scope.system=all) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:19.995607 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29c3ae-43b2-4e08-b44d-92dbc89b9714 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:19.997237 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29c3ae-43b2-4e08-b44d-92dbc89b9714 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:20.003191 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3f543-1a77-4682-9c5e-29e27fe75848 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:20.010709 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 179/349] 10.222.0.55 () {56 vars in 1308 bytes} [Tue May 3 09:47:19 2022] GET /identity/v3/role_assignments?user.id=b51919dbb5af4f32a942b92cc5b06c52&scope.system=all&role.id=2f97989a57b241f18734bf5df7ebe048 => generated 510 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:20.012341 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0a1a6-9aea-4bdb-9695-ef82f0eb1e97 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:20.012836 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0a1a6-9aea-4bdb-9695-ef82f0eb1e97 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:20.013315 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0a1a6-9aea-4bdb-9695-ef82f0eb1e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:20.030791 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-b2a0a1a6-9aea-4bdb-9695-ef82f0eb1e97 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:20.032342 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-b2a0a1a6-9aea-4bdb-9695-ef82f0eb1e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:20.063262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa29dbf-ad6d-4cf6-b2ff-d296841557c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:20.064081 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa29dbf-ad6d-4cf6-b2ff-d296841557c1 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:20.064363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa29dbf-ad6d-4cf6-b2ff-d296841557c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:20.064635 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa29dbf-ad6d-4cf6-b2ff-d296841557c1 None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:20.070967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa29dbf-ad6d-4cf6-b2ff-d296841557c1 None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:20.072801 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa29dbf-ad6d-4cf6-b2ff-d296841557c1 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:20.074954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 171/350] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:19 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:20.075550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa29dbf-ad6d-4cf6-b2ff-d296841557c1 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:20.111592 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 180/351] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:20.112766 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0a1a6-9aea-4bdb-9695-ef82f0eb1e97 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:20.202929 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa29dbf-ad6d-4cf6-b2ff-d296841557c1 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:20.216469 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0a1a6-9aea-4bdb-9695-ef82f0eb1e97 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:20.239470 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec79a43-1d40-4cfd-9fc9-70477921a567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:20.240080 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec79a43-1d40-4cfd-9fc9-70477921a567 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:20.240364 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec79a43-1d40-4cfd-9fc9-70477921a567 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:20.240641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec79a43-1d40-4cfd-9fc9-70477921a567 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:20.241405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec79a43-1d40-4cfd-9fc9-70477921a567 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:20.241711 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec79a43-1d40-4cfd-9fc9-70477921a567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:20.243544 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec79a43-1d40-4cfd-9fc9-70477921a567 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:20.254891 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 172/352] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:20.255844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec79a43-1d40-4cfd-9fc9-70477921a567 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:20.262785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d72b27-10a8-47eb-81b4-60bdfd8a0301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:20.264097 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d72b27-10a8-47eb-81b4-60bdfd8a0301 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:20.264574 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d72b27-10a8-47eb-81b4-60bdfd8a0301 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:20.265051 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d72b27-10a8-47eb-81b4-60bdfd8a0301 None admin] PATH_INFO: `/v3/groups/7135f4bdb3a34472a3a18426d6749a46` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:20.272115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d72b27-10a8-47eb-81b4-60bdfd8a0301 None admin] RBAC: Authorizing `identity:get_group(group_id=7135f4bdb3a34472a3a18426d6749a46)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:20.274050 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d72b27-10a8-47eb-81b4-60bdfd8a0301 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:20.276362 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 181/353] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 3 09:47:20 2022] GET /identity/v3/groups/7135f4bdb3a34472a3a18426d6749a46 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:20.277320 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d72b27-10a8-47eb-81b4-60bdfd8a0301 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:20.361386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec79a43-1d40-4cfd-9fc9-70477921a567 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:20.387997 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d72b27-10a8-47eb-81b4-60bdfd8a0301 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:20.398124 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2bf33-afe5-4bc8-a69f-45712ad8886b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:20.399352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2bf33-afe5-4bc8-a69f-45712ad8886b None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:20.399632 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2bf33-afe5-4bc8-a69f-45712ad8886b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:20.399905 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2bf33-afe5-4bc8-a69f-45712ad8886b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:20.411190 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2bf33-afe5-4bc8-a69f-45712ad8886b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:20.419841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-77b2bf33-afe5-4bc8-a69f-45712ad8886b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:20.419841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:20.419841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:20.419841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:20.419841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:20.419841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:20.419841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:20.419841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:20.419841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:20.419841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:20.419841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:20.419841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:20.419841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:20.419841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:20.419841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:20.419841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:20.420760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:20.420760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:20.420760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:20.420760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:20.420760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:20.420760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:20.420760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:20.420760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:20.420760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:20.420760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:20.420760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:20.420760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:20.420760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:20.420760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:20.420760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:20.420760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:20.421535 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:20.421535 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:20.421535 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:20.421535 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:20.421535 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:20.421535 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:20.421535 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:20.421535 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:20.421535 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:20.421535 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:20.421535 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:20.421535 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:20.421535 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 173/354] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:20.422358 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2bf33-afe5-4bc8-a69f-45712ad8886b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:20.425638 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb1cac-667c-4ba2-b31d-81db5fe9d63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:20.426326 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb1cac-667c-4ba2-b31d-81db5fe9d63f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:20.426599 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb1cac-667c-4ba2-b31d-81db5fe9d63f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:20.426871 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb1cac-667c-4ba2-b31d-81db5fe9d63f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:20.511602 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb1cac-667c-4ba2-b31d-81db5fe9d63f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:20.513167 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb1cac-667c-4ba2-b31d-81db5fe9d63f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:20.535676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2bf33-afe5-4bc8-a69f-45712ad8886b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:20.574018 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66624d0-d5c2-4047-b749-b0f687d12f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:20.574672 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66624d0-d5c2-4047-b749-b0f687d12f46 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:20.574947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66624d0-d5c2-4047-b749-b0f687d12f46 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:20.575212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66624d0-d5c2-4047-b749-b0f687d12f46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:20.576429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66624d0-d5c2-4047-b749-b0f687d12f46 None admin] RBAC: Adding query filter params (group.id=7135f4bdb3a34472a3a18426d6749a46, role.id=9e77c7f209fd4468bcf1b89bfef3c236, scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:20.576429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66624d0-d5c2-4047-b749-b0f687d12f46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:20.577754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66624d0-d5c2-4047-b749-b0f687d12f46 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:20.583241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 174/355] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 3 09:47:20 2022] GET /identity/v3/role_assignments?group.id=7135f4bdb3a34472a3a18426d6749a46&scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e&role.id=9e77c7f209fd4468bcf1b89bfef3c236 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:20.584478 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca09437-49ed-4ccb-9006-c3f58b6c8857 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:20.584756 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca09437-49ed-4ccb-9006-c3f58b6c8857 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:20.585046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca09437-49ed-4ccb-9006-c3f58b6c8857 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:20.586604 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 175/356] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:20.587176 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca09437-49ed-4ccb-9006-c3f58b6c8857 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:20.644884 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 182/357] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:20.647143 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995be1f2-7718-4793-b0b4-00c342e3c2b1 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:20.647666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995be1f2-7718-4793-b0b4-00c342e3c2b1 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:20.648147 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995be1f2-7718-4793-b0b4-00c342e3c2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:20.670899 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-995be1f2-7718-4793-b0b4-00c342e3c2b1 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:20.672994 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-995be1f2-7718-4793-b0b4-00c342e3c2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:20.711243 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca09437-49ed-4ccb-9006-c3f58b6c8857 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:20.747588 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc7dcd-ef1d-4ecf-b765-674e6bd08a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:20.748266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc7dcd-ef1d-4ecf-b765-674e6bd08a21 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:20.748532 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc7dcd-ef1d-4ecf-b765-674e6bd08a21 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:20.748805 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc7dcd-ef1d-4ecf-b765-674e6bd08a21 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:20.749606 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc7dcd-ef1d-4ecf-b765-674e6bd08a21 None admin] RBAC: Adding query filter params (name=member) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:20.749951 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc7dcd-ef1d-4ecf-b765-674e6bd08a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:20.751398 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc7dcd-ef1d-4ecf-b765-674e6bd08a21 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:20.755629 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 183/358] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:20.757056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995be1f2-7718-4793-b0b4-00c342e3c2b1 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:20.766678 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 176/359] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:20.771878 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc7dcd-ef1d-4ecf-b765-674e6bd08a21 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:20.862506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995be1f2-7718-4793-b0b4-00c342e3c2b1 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:20.885329 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc7dcd-ef1d-4ecf-b765-674e6bd08a21 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:20.898263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd155e-a501-408b-a8ad-1a6a6d52ac70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:20.899581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd155e-a501-408b-a8ad-1a6a6d52ac70 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:20.900090 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd155e-a501-408b-a8ad-1a6a6d52ac70 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:20.900569 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd155e-a501-408b-a8ad-1a6a6d52ac70 None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:20.902178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd155e-a501-408b-a8ad-1a6a6d52ac70 None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:20.903929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd155e-a501-408b-a8ad-1a6a6d52ac70 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:20.906522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 184/360] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:20 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:20.907601 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd155e-a501-408b-a8ad-1a6a6d52ac70 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:20.926595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fe2c4-8260-4565-9455-36451786f3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:20.927369 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fe2c4-8260-4565-9455-36451786f3cf None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:20.927544 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fe2c4-8260-4565-9455-36451786f3cf None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:20.927798 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fe2c4-8260-4565-9455-36451786f3cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:20.995415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fe2c4-8260-4565-9455-36451786f3cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:20.996870 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fe2c4-8260-4565-9455-36451786f3cf None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:21.010872 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd155e-a501-408b-a8ad-1a6a6d52ac70 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:21.046145 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ded2d-1c79-4555-b89e-31d0e905e64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:21.047339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ded2d-1c79-4555-b89e-31d0e905e64a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:21.047825 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ded2d-1c79-4555-b89e-31d0e905e64a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:21.048293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ded2d-1c79-4555-b89e-31d0e905e64a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:21.059203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ded2d-1c79-4555-b89e-31d0e905e64a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:21.069027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-3f8ded2d-1c79-4555-b89e-31d0e905e64a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:21.069027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:21.069027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:21.069027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:21.069027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:21.069027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:21.069027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:21.069027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:21.069027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:21.069027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:21.069027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:21.069027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:21.069027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:21.069027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:21.069027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:21.069027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:21.069979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:21.069979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:21.069979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:21.069979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:21.069979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:21.069979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:21.069979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:21.069979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:21.069979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:21.069979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:21.069979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:21.069979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:21.069979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:21.069979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:21.069979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:21.069979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:21.070840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:21.070840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:21.070840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:21.070840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:21.070840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:21.070840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:21.070840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:21.070840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:21.070840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:21.070840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:21.070840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:21.070840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:21.073389 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 185/361] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:47:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:21.074492 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ded2d-1c79-4555-b89e-31d0e905e64a None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:21.100630 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 177/362] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 09:47:21.101614 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fe2c4-8260-4565-9455-36451786f3cf None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:21.197128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ded2d-1c79-4555-b89e-31d0e905e64a None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:21.228121 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fe2c4-8260-4565-9455-36451786f3cf None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:21.232879 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca3ac2-e041-4a62-9f72-9d29079e9454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:21.233746 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca3ac2-e041-4a62-9f72-9d29079e9454 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:21.234050 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca3ac2-e041-4a62-9f72-9d29079e9454 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:21.234326 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca3ac2-e041-4a62-9f72-9d29079e9454 None admin] PATH_INFO: `/v3/groups/7135f4bdb3a34472a3a18426d6749a46` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:21.235503 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca3ac2-e041-4a62-9f72-9d29079e9454 None admin] RBAC: Authorizing `identity:get_group(group_id=7135f4bdb3a34472a3a18426d6749a46)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:21.238412 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca3ac2-e041-4a62-9f72-9d29079e9454 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:21.241601 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 186/363] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 3 09:47:21 2022] GET /identity/v3/groups/7135f4bdb3a34472a3a18426d6749a46 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:21.241601 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca3ac2-e041-4a62-9f72-9d29079e9454 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:21.275356 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f05d4-277b-4359-9151-d05096dbcf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:21.276033 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f05d4-277b-4359-9151-d05096dbcf8a None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:21.276436 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f05d4-277b-4359-9151-d05096dbcf8a None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:21.276604 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f05d4-277b-4359-9151-d05096dbcf8a None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:21.277374 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f05d4-277b-4359-9151-d05096dbcf8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:21.277637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f05d4-277b-4359-9151-d05096dbcf8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:21.279030 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f05d4-277b-4359-9151-d05096dbcf8a None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:21.291260 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 178/364] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:21.292905 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fa5c4-75fb-4890-8514-cc64a3781ce6 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:21.293196 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fa5c4-75fb-4890-8514-cc64a3781ce6 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:21.293470 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fa5c4-75fb-4890-8514-cc64a3781ce6 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:21.294874 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 179/365] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:21.296779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fa5c4-75fb-4890-8514-cc64a3781ce6 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:21.358579 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca3ac2-e041-4a62-9f72-9d29079e9454 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:21.395874 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708db61e-050f-4600-b3db-ca4efd074483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:21.396258 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708db61e-050f-4600-b3db-ca4efd074483 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:21.396458 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708db61e-050f-4600-b3db-ca4efd074483 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:21.396724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708db61e-050f-4600-b3db-ca4efd074483 None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:21.399746 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708db61e-050f-4600-b3db-ca4efd074483 None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:21.401212 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708db61e-050f-4600-b3db-ca4efd074483 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:21.403024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 187/366] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:21 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:21.409392 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708db61e-050f-4600-b3db-ca4efd074483 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:21.417191 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fa5c4-75fb-4890-8514-cc64a3781ce6 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:21.458373 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54196274-de46-4cea-bd4f-9debcf340bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:21.459375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54196274-de46-4cea-bd4f-9debcf340bc4 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:21.459848 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54196274-de46-4cea-bd4f-9debcf340bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:21.460315 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54196274-de46-4cea-bd4f-9debcf340bc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:21.461244 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54196274-de46-4cea-bd4f-9debcf340bc4 None admin] RBAC: Adding query filter params (group.id=7135f4bdb3a34472a3a18426d6749a46, role.id=cb8032f764644c90a3dc0cb396434d67, scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:21.461557 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54196274-de46-4cea-bd4f-9debcf340bc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:21.463091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54196274-de46-4cea-bd4f-9debcf340bc4 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:21.470178 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 180/367] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 3 09:47:21 2022] GET /identity/v3/role_assignments?group.id=7135f4bdb3a34472a3a18426d6749a46&scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e&role.id=cb8032f764644c90a3dc0cb396434d67 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:21.470178 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e90a3-834f-42ae-84c7-debef231ceef None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:21.470411 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e90a3-834f-42ae-84c7-debef231ceef None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:21.471625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e90a3-834f-42ae-84c7-debef231ceef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:21.490783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-b48e90a3-834f-42ae-84c7-debef231ceef None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:21.492005 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-b48e90a3-834f-42ae-84c7-debef231ceef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:21.526607 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708db61e-050f-4600-b3db-ca4efd074483 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:21.562936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f97a51-d517-413b-9239-f8ca03284f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:21.563594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f97a51-d517-413b-9239-f8ca03284f4d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:21.563875 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f97a51-d517-413b-9239-f8ca03284f4d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:21.564145 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f97a51-d517-413b-9239-f8ca03284f4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:21.566716 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 181/368] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:21.567664 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e90a3-834f-42ae-84c7-debef231ceef None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:21.641850 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f97a51-d517-413b-9239-f8ca03284f4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:21.643330 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f97a51-d517-413b-9239-f8ca03284f4d None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:21.673936 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e90a3-834f-42ae-84c7-debef231ceef None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:21.709764 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5010ef6-c094-4fa0-9c2d-37f7b9d70f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:21.710633 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5010ef6-c094-4fa0-9c2d-37f7b9d70f79 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:21.710884 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5010ef6-c094-4fa0-9c2d-37f7b9d70f79 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:21.711157 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5010ef6-c094-4fa0-9c2d-37f7b9d70f79 None admin] PATH_INFO: `/v3/groups/7135f4bdb3a34472a3a18426d6749a46` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:21.712796 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5010ef6-c094-4fa0-9c2d-37f7b9d70f79 None admin] RBAC: Authorizing `identity:get_group(group_id=7135f4bdb3a34472a3a18426d6749a46)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:21.714268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5010ef6-c094-4fa0-9c2d-37f7b9d70f79 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:21.716213 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 182/369] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 3 09:47:21 2022] GET /identity/v3/groups/7135f4bdb3a34472a3a18426d6749a46 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:21.716994 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5010ef6-c094-4fa0-9c2d-37f7b9d70f79 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:21.754923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 188/370] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:21.756094 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f97a51-d517-413b-9239-f8ca03284f4d None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:21.831160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5010ef6-c094-4fa0-9c2d-37f7b9d70f79 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:21.855775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f97a51-d517-413b-9239-f8ca03284f4d None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:21.872045 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f1cfe-b058-45ea-93ae-0e23a89be351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:21.872872 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1cfe-b058-45ea-93ae-0e23a89be351 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:21.873153 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1cfe-b058-45ea-93ae-0e23a89be351 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:21.873427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1cfe-b058-45ea-93ae-0e23a89be351 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:21.885278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f1cfe-b058-45ea-93ae-0e23a89be351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:21.895864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-a91f1cfe-b058-45ea-93ae-0e23a89be351 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:47:21.895864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:21.895864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:21.895864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:21.895864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:21.895864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:21.895864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:21.895864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:21.895864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:21.895864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:21.895864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:21.895864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:21.895864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:21.895864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:21.895864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:21.895864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:21.896780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:21.896780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:21.896780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:21.896780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:21.896780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:21.896780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:21.896780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:21.896780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:21.896780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:21.896780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:21.896780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:21.896780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:21.896780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:21.896780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:21.896780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:21.896780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:21.897572 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:21.897572 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:21.897572 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:21.897572 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:21.897572 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:21.897572 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:21.897572 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:21.897572 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:21.897572 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:21.897572 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:21.897572 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:47:21.897572 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:21.899376 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 183/371] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:47:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:21.901853 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f1cfe-b058-45ea-93ae-0e23a89be351 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:21.904690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3d2b4-beef-4edb-9190-e7ce1d943993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:21.905930 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3d2b4-beef-4edb-9190-e7ce1d943993 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:21.908152 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3d2b4-beef-4edb-9190-e7ce1d943993 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:21.908428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3d2b4-beef-4edb-9190-e7ce1d943993 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:21.909279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3d2b4-beef-4edb-9190-e7ce1d943993 None admin] RBAC: Adding query filter params (group.id=7135f4bdb3a34472a3a18426d6749a46, role.id=9e77c7f209fd4468bcf1b89bfef3c236, scope.project.id=8a5cae0345914eccba509f41e0ddf7a5) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:21.909588 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3d2b4-beef-4edb-9190-e7ce1d943993 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:21.911439 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3d2b4-beef-4edb-9190-e7ce1d943993 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:21.917894 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 189/372] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 3 09:47:21 2022] GET /identity/v3/role_assignments?group.id=7135f4bdb3a34472a3a18426d6749a46&scope.project.id=8a5cae0345914eccba509f41e0ddf7a5&role.id=9e77c7f209fd4468bcf1b89bfef3c236 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:21.918831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3d2b4-beef-4edb-9190-e7ce1d943993 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:22.011735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f1cfe-b058-45ea-93ae-0e23a89be351 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:22.023546 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3d2b4-beef-4edb-9190-e7ce1d943993 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:22.058085 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32a629-4d80-4d3b-b460-c2b15a0dd8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:22.059320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32a629-4d80-4d3b-b460-c2b15a0dd8dc None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:22.059812 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32a629-4d80-4d3b-b460-c2b15a0dd8dc None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:22.060297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32a629-4d80-4d3b-b460-c2b15a0dd8dc None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:22.062288 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e43589-3cbe-4ceb-ab5c-44e57c807e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:22.062970 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e43589-3cbe-4ceb-ab5c-44e57c807e15 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:22.063251 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e43589-3cbe-4ceb-ab5c-44e57c807e15 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:22.063526 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e43589-3cbe-4ceb-ab5c-44e57c807e15 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:22.063899 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32a629-4d80-4d3b-b460-c2b15a0dd8dc None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:22.064290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e43589-3cbe-4ceb-ab5c-44e57c807e15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:22.064595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e43589-3cbe-4ceb-ab5c-44e57c807e15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:22.066004 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32a629-4d80-4d3b-b460-c2b15a0dd8dc None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:22.067345 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e43589-3cbe-4ceb-ab5c-44e57c807e15 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:22.068245 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 184/373] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:21 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:22.074429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32a629-4d80-4d3b-b460-c2b15a0dd8dc None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:22.081943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 190/374] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:22.083666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e43589-3cbe-4ceb-ab5c-44e57c807e15 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:22.180973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32a629-4d80-4d3b-b460-c2b15a0dd8dc None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:22.202519 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e43589-3cbe-4ceb-ab5c-44e57c807e15 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:22.215541 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1181a9-65c6-46d5-95cf-64a775f983dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:22.216805 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1181a9-65c6-46d5-95cf-64a775f983dd None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:22.217278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1181a9-65c6-46d5-95cf-64a775f983dd None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:22.217742 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1181a9-65c6-46d5-95cf-64a775f983dd None admin] PATH_INFO: `/v3/groups/7135f4bdb3a34472a3a18426d6749a46` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:22.219194 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1181a9-65c6-46d5-95cf-64a775f983dd None admin] RBAC: Authorizing `identity:get_group(group_id=7135f4bdb3a34472a3a18426d6749a46)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:22.220830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1181a9-65c6-46d5-95cf-64a775f983dd None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:22.223000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 185/375] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 3 09:47:22 2022] GET /identity/v3/groups/7135f4bdb3a34472a3a18426d6749a46 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:22.228333 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1181a9-65c6-46d5-95cf-64a775f983dd None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:22.239984 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42c4cb-c02e-4683-bf1d-beccbffbce78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:22.240641 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42c4cb-c02e-4683-bf1d-beccbffbce78 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:22.240925 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42c4cb-c02e-4683-bf1d-beccbffbce78 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:22.241196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42c4cb-c02e-4683-bf1d-beccbffbce78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:22.319723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42c4cb-c02e-4683-bf1d-beccbffbce78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:22.321374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42c4cb-c02e-4683-bf1d-beccbffbce78 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:22.333967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1181a9-65c6-46d5-95cf-64a775f983dd None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:22.368218 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da405f2d-00ff-4e7b-b5be-7b60463b559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:22.369225 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da405f2d-00ff-4e7b-b5be-7b60463b559e None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:22.369726 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da405f2d-00ff-4e7b-b5be-7b60463b559e None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:22.370235 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da405f2d-00ff-4e7b-b5be-7b60463b559e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:22.371264 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da405f2d-00ff-4e7b-b5be-7b60463b559e None admin] RBAC: Adding query filter params (group.id=7135f4bdb3a34472a3a18426d6749a46, role.id=cb8032f764644c90a3dc0cb396434d67, scope.project.id=8a5cae0345914eccba509f41e0ddf7a5) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:22.371764 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da405f2d-00ff-4e7b-b5be-7b60463b559e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:22.373375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da405f2d-00ff-4e7b-b5be-7b60463b559e None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:22.379624 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 186/376] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 3 09:47:22 2022] GET /identity/v3/role_assignments?group.id=7135f4bdb3a34472a3a18426d6749a46&scope.project.id=8a5cae0345914eccba509f41e0ddf7a5&role.id=cb8032f764644c90a3dc0cb396434d67 => generated 260 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:22.427543 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 191/377] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 09:47:22.433392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da405f2d-00ff-4e7b-b5be-7b60463b559e None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:22.541086 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da405f2d-00ff-4e7b-b5be-7b60463b559e None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:22.583856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13548422-d8e2-432b-9306-5dac5d0addca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:22.585157 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13548422-d8e2-432b-9306-5dac5d0addca None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:22.585641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13548422-d8e2-432b-9306-5dac5d0addca None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:22.586244 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13548422-d8e2-432b-9306-5dac5d0addca None admin] PATH_INFO: `/v3/projects/4434afe425d5493fb9f74ff63598d4e4` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:22.587898 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13548422-d8e2-432b-9306-5dac5d0addca None admin] RBAC: Authorizing `identity:get_project(project_id=4434afe425d5493fb9f74ff63598d4e4)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:22.589565 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13548422-d8e2-432b-9306-5dac5d0addca None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:22.591826 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 187/378] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:22 2022] GET /identity/v3/projects/4434afe425d5493fb9f74ff63598d4e4 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:22.597324 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42c4cb-c02e-4683-bf1d-beccbffbce78 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:22.701560 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42c4cb-c02e-4683-bf1d-beccbffbce78 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:22.736995 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7067e50-55a9-4e36-a055-0886bcf966d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:22.738265 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7067e50-55a9-4e36-a055-0886bcf966d6 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:22.738750 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7067e50-55a9-4e36-a055-0886bcf966d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:22.739201 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7067e50-55a9-4e36-a055-0886bcf966d6 None admin] PATH_INFO: `/v3/groups/861e52401c924736afd78518cf95360e` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:22.744592 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7067e50-55a9-4e36-a055-0886bcf966d6 None admin] RBAC: Authorizing `identity:get_group(group_id=861e52401c924736afd78518cf95360e)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:22.746376 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7067e50-55a9-4e36-a055-0886bcf966d6 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:22.748552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 192/379] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 3 09:47:22 2022] GET /identity/v3/groups/861e52401c924736afd78518cf95360e => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:22.754386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13548422-d8e2-432b-9306-5dac5d0addca None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:22.887441 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13548422-d8e2-432b-9306-5dac5d0addca None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:22.927780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a8b30-bd1f-402e-b211-b8fa61950c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:22.928440 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a8b30-bd1f-402e-b211-b8fa61950c90 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:22.928804 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a8b30-bd1f-402e-b211-b8fa61950c90 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:22.929083 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a8b30-bd1f-402e-b211-b8fa61950c90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:22.930024 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a8b30-bd1f-402e-b211-b8fa61950c90 None admin] RBAC: Adding query filter params (group.id=861e52401c924736afd78518cf95360e, role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=4434afe425d5493fb9f74ff63598d4e4) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:22.930335 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a8b30-bd1f-402e-b211-b8fa61950c90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:22.931772 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a8b30-bd1f-402e-b211-b8fa61950c90 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:22.942698 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 188/380] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 3 09:47:22 2022] GET /identity/v3/role_assignments?group.id=861e52401c924736afd78518cf95360e&scope.project.id=4434afe425d5493fb9f74ff63598d4e4&role.id=52d3ad3e32c741938997691c9a909b81 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:23.333230 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354ad9b-c0fe-4560-91e2-da1f89f9947c None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:23.334090 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354ad9b-c0fe-4560-91e2-da1f89f9947c None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:23.334365 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354ad9b-c0fe-4560-91e2-da1f89f9947c None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:23.335894 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 193/381] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:23.341337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0fb55-92ee-40b6-8069-d9f66c4e4d22 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:23.341623 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0fb55-92ee-40b6-8069-d9f66c4e4d22 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:23.341920 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0fb55-92ee-40b6-8069-d9f66c4e4d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:23.362007 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-ccd0fb55-92ee-40b6-8069-d9f66c4e4d22 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:23.363178 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-ccd0fb55-92ee-40b6-8069-d9f66c4e4d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:23.434473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 189/382] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:23.470981 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354ad9b-c0fe-4560-91e2-da1f89f9947c None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:23.598291 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354ad9b-c0fe-4560-91e2-da1f89f9947c None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:23.638753 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb68a37-027c-4415-b545-1e0389522824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:23.639566 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb68a37-027c-4415-b545-1e0389522824 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:23.639845 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb68a37-027c-4415-b545-1e0389522824 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:23.640114 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb68a37-027c-4415-b545-1e0389522824 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:23.658745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb68a37-027c-4415-b545-1e0389522824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:23.666725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-fcb68a37-027c-4415-b545-1e0389522824 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:23.666725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:23.666725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:23.666725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:23.666725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:23.666725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:23.666725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:23.666725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:23.666725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:23.666725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:23.666725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:23.666725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:23.666725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:23.666725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:23.666725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:23.666725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:23.667639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:23.667639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:23.667639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:23.667639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:23.667639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:23.667639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:23.667639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:23.667639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:23.667639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:23.667639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:23.667639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:23.667639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:23.667639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:23.667639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:23.667639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:23.667639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:23.668430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:23.668430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:23.668430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:23.668430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:23.668430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:23.668430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:23.668430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:23.668430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:23.668430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:23.668430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:23.668430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:23.668430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:23.668430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 194/383] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:23.675495 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0fb55-92ee-40b6-8069-d9f66c4e4d22 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:23.792429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0fb55-92ee-40b6-8069-d9f66c4e4d22 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:23.833147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd14c2-cd05-4329-a696-b13b3b5a9b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:23.833836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd14c2-cd05-4329-a696-b13b3b5a9b8a None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:23.834116 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd14c2-cd05-4329-a696-b13b3b5a9b8a None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:23.834383 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd14c2-cd05-4329-a696-b13b3b5a9b8a None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:23.835130 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd14c2-cd05-4329-a696-b13b3b5a9b8a None admin] RBAC: Adding query filter params (name=member) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:23.835426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd14c2-cd05-4329-a696-b13b3b5a9b8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:23.836905 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd14c2-cd05-4329-a696-b13b3b5a9b8a None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:23.845682 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 190/384] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:23.851618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb68a37-027c-4415-b545-1e0389522824 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:24.005733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb68a37-027c-4415-b545-1e0389522824 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:24.050581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb348e-9dfc-4543-8cf2-b8a45ab523b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:24.051856 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb348e-9dfc-4543-8cf2-b8a45ab523b3 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:24.052355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb348e-9dfc-4543-8cf2-b8a45ab523b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:24.052822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb348e-9dfc-4543-8cf2-b8a45ab523b3 None admin] PATH_INFO: `/v3/groups/7135f4bdb3a34472a3a18426d6749a46` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:24.054345 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb348e-9dfc-4543-8cf2-b8a45ab523b3 None admin] RBAC: Authorizing `identity:get_group(group_id=7135f4bdb3a34472a3a18426d6749a46)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:24.056739 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb348e-9dfc-4543-8cf2-b8a45ab523b3 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:24.058924 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 195/385] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 3 09:47:23 2022] GET /identity/v3/groups/7135f4bdb3a34472a3a18426d6749a46 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:24.064644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd14c2-cd05-4329-a696-b13b3b5a9b8a None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:24.180616 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd14c2-cd05-4329-a696-b13b3b5a9b8a None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:24.221492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34d422-8a2a-4880-b9df-dcb4826f8f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:24.222403 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34d422-8a2a-4880-b9df-dcb4826f8f4f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:24.222679 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34d422-8a2a-4880-b9df-dcb4826f8f4f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:24.222946 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34d422-8a2a-4880-b9df-dcb4826f8f4f None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:24.224211 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34d422-8a2a-4880-b9df-dcb4826f8f4f None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:24.225654 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34d422-8a2a-4880-b9df-dcb4826f8f4f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:24.227662 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 191/386] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:24 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:24.234358 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb348e-9dfc-4543-8cf2-b8a45ab523b3 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:24.381484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb348e-9dfc-4543-8cf2-b8a45ab523b3 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:24.406523 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34824f0-8524-4b8e-a2cc-631dc97d3c55 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:24.406992 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34824f0-8524-4b8e-a2cc-631dc97d3c55 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:24.407261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34824f0-8524-4b8e-a2cc-631dc97d3c55 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:24.408921 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 192/387] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:24.414017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73355cd7-e7d8-4e24-b760-8e5a2e5d2d99 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:24.414308 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73355cd7-e7d8-4e24-b760-8e5a2e5d2d99 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:24.414576 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73355cd7-e7d8-4e24-b760-8e5a2e5d2d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:24.433618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0309d-a972-4d96-92b7-2fa53bd0ae83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:24.434471 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0309d-a972-4d96-92b7-2fa53bd0ae83 None admin] REQUEST_METHOD: `PUT` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:24.434748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0309d-a972-4d96-92b7-2fa53bd0ae83 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:24.435188 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0309d-a972-4d96-92b7-2fa53bd0ae83 None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e/groups/7135f4bdb3a34472a3a18426d6749a46/roles/9e77c7f209fd4468bcf1b89bfef3c236` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:24.437271 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0309d-a972-4d96-92b7-2fa53bd0ae83 None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb6e6402b314d21a8beef0b41fcae2e, group_id=7135f4bdb3a34472a3a18426d6749a46, role_id=9e77c7f209fd4468bcf1b89bfef3c236)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:24.438821 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0309d-a972-4d96-92b7-2fa53bd0ae83 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:24.442937 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-73355cd7-e7d8-4e24-b760-8e5a2e5d2d99 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:24.444118 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-73355cd7-e7d8-4e24-b760-8e5a2e5d2d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:24.462997 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 196/388] 10.222.0.55 () {58 vars in 1442 bytes} [Tue May 3 09:47:24 2022] PUT /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e/groups/7135f4bdb3a34472a3a18426d6749a46/roles/9e77c7f209fd4468bcf1b89bfef3c236 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:47:24.520705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 193/389] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:24.546209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0309d-a972-4d96-92b7-2fa53bd0ae83 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:24.664053 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0309d-a972-4d96-92b7-2fa53bd0ae83 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:24.702622 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e85703-9146-4e21-8ad7-36c298d55932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:24.703781 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e85703-9146-4e21-8ad7-36c298d55932 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:24.704286 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e85703-9146-4e21-8ad7-36c298d55932 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:24.704731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e85703-9146-4e21-8ad7-36c298d55932 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:24.718695 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e85703-9146-4e21-8ad7-36c298d55932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:24.727382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-44e85703-9146-4e21-8ad7-36c298d55932 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:24.727382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:24.727382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:24.727382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:24.727382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:24.727382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:24.727382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:24.727382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:24.727382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:24.727382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:24.727382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:24.727382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:24.727382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:24.727382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:24.727382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:24.727382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:24.728443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:24.728443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:24.728443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:24.728443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:24.728443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:24.728443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:24.728443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:24.728443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:24.728443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:24.728443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:24.728443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:24.728443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:24.728443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:24.728443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:24.728443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:24.728443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:24.729264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:24.729264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:24.729264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:24.729264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:24.729264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:24.729264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:24.729264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:24.729264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:24.729264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:24.729264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:24.729264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:24.729264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:24.731600 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 197/390] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:47:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:24.737628 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73355cd7-e7d8-4e24-b760-8e5a2e5d2d99 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:24.878560 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73355cd7-e7d8-4e24-b760-8e5a2e5d2d99 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:24.918111 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba1273-3dc2-49a6-81fe-5521b88252c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:24.919098 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba1273-3dc2-49a6-81fe-5521b88252c5 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:24.919516 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba1273-3dc2-49a6-81fe-5521b88252c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:24.919947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba1273-3dc2-49a6-81fe-5521b88252c5 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:24.920900 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba1273-3dc2-49a6-81fe-5521b88252c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:24.921352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba1273-3dc2-49a6-81fe-5521b88252c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:24.922948 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba1273-3dc2-49a6-81fe-5521b88252c5 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:24.933856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 194/391] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:24.939762 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e85703-9146-4e21-8ad7-36c298d55932 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:25.060137 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e85703-9146-4e21-8ad7-36c298d55932 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:25.100645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b93fa-0d16-4f49-b8c9-4baac6d20508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:25.101836 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b93fa-0d16-4f49-b8c9-4baac6d20508 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:25.102253 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b93fa-0d16-4f49-b8c9-4baac6d20508 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:25.102657 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b93fa-0d16-4f49-b8c9-4baac6d20508 None admin] PATH_INFO: `/v3/groups/7135f4bdb3a34472a3a18426d6749a46` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:25.104780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b93fa-0d16-4f49-b8c9-4baac6d20508 None admin] RBAC: Authorizing `identity:get_group(group_id=7135f4bdb3a34472a3a18426d6749a46)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:25.106399 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b93fa-0d16-4f49-b8c9-4baac6d20508 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:25.108513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 198/392] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 3 09:47:24 2022] GET /identity/v3/groups/7135f4bdb3a34472a3a18426d6749a46 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:25.114210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba1273-3dc2-49a6-81fe-5521b88252c5 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:25.134656 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec949a-d00d-4e26-b7c7-f0ba13f9e75d None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:25.135192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec949a-d00d-4e26-b7c7-f0ba13f9e75d None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:25.135604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec949a-d00d-4e26-b7c7-f0ba13f9e75d None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:25.137928 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 199/393] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:47:25.145701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d63302-d2e2-46ef-8198-8079e1a0a258 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:25.146192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d63302-d2e2-46ef-8198-8079e1a0a258 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:25.146870 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d63302-d2e2-46ef-8198-8079e1a0a258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:25.174809 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-a5d63302-d2e2-46ef-8198-8079e1a0a258 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:25.175977 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-a5d63302-d2e2-46ef-8198-8079e1a0a258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:25.241295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba1273-3dc2-49a6-81fe-5521b88252c5 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:25.280463 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cfe68-490f-4ab2-96eb-4b8149e4dd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:25.281614 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cfe68-490f-4ab2-96eb-4b8149e4dd5c None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:25.282057 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cfe68-490f-4ab2-96eb-4b8149e4dd5c None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:25.282537 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cfe68-490f-4ab2-96eb-4b8149e4dd5c None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:25.284953 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cfe68-490f-4ab2-96eb-4b8149e4dd5c None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:25.286575 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cfe68-490f-4ab2-96eb-4b8149e4dd5c None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:25.293989 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 195/394] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:25 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:25.304641 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 200/395] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:47:25.307329 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cfe68-490f-4ab2-96eb-4b8149e4dd5c None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:25.338782 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d63302-d2e2-46ef-8198-8079e1a0a258 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:25.459918 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d63302-d2e2-46ef-8198-8079e1a0a258 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:25.468208 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cfe68-490f-4ab2-96eb-4b8149e4dd5c None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:25.502919 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180b60d-6409-466f-835d-86d6c405d89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:25.503815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe1e4c-cba7-4c57-9c74-f44d01b6e9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:25.503935 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180b60d-6409-466f-835d-86d6c405d89c None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:25.504143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180b60d-6409-466f-835d-86d6c405d89c None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:25.504385 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180b60d-6409-466f-835d-86d6c405d89c None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e/groups/7135f4bdb3a34472a3a18426d6749a46/roles/cb8032f764644c90a3dc0cb396434d67` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:25.505311 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe1e4c-cba7-4c57-9c74-f44d01b6e9c3 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:25.505821 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe1e4c-cba7-4c57-9c74-f44d01b6e9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:25.506288 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe1e4c-cba7-4c57-9c74-f44d01b6e9c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:25.506626 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180b60d-6409-466f-835d-86d6c405d89c None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb6e6402b314d21a8beef0b41fcae2e, group_id=7135f4bdb3a34472a3a18426d6749a46, role_id=cb8032f764644c90a3dc0cb396434d67)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:25.508538 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180b60d-6409-466f-835d-86d6c405d89c None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:25.522179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe1e4c-cba7-4c57-9c74-f44d01b6e9c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:25.528212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 196/396] 10.222.0.55 () {58 vars in 1442 bytes} [Tue May 3 09:47:25 2022] PUT /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e/groups/7135f4bdb3a34472a3a18426d6749a46/roles/cb8032f764644c90a3dc0cb396434d67 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:47:25.529592 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd1160-f63f-4d2a-bf89-8d35100a51cd None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:25.529897 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd1160-f63f-4d2a-bf89-8d35100a51cd None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:25.530170 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd1160-f63f-4d2a-bf89-8d35100a51cd None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:25.532116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-7dbe1e4c-cba7-4c57-9c74-f44d01b6e9c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:25.532116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:25.532116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:25.532116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:25.532116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:25.532116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:25.532116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:25.532116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:25.532116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:25.532116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:25.532116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:25.532116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:25.532116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:25.532116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:25.532116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:25.532116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:25.532990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:25.532990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:25.532990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:25.532990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:25.532990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:25.532990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:25.532990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:25.532990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:25.532990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:25.532990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:25.532990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:25.532990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:25.532990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:25.532990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:25.532990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:25.532990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:25.533832 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:25.533832 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:25.533832 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:25.533832 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:25.533832 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:25.533832 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:25.533832 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:25.533832 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:25.533832 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:25.533832 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:25.533832 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:25.533832 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:25.536713 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 201/397] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:25.545257 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe1e4c-cba7-4c57-9c74-f44d01b6e9c3 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:25.549994 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 197/398] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:25 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:25.551380 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeea3e-267d-4747-b9b0-03a2bf6b4e33 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:25.551668 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeea3e-267d-4747-b9b0-03a2bf6b4e33 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:25.551943 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeea3e-267d-4747-b9b0-03a2bf6b4e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:25.591159 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-aaaeea3e-267d-4747-b9b0-03a2bf6b4e33 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:25.594225 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-aaaeea3e-267d-4747-b9b0-03a2bf6b4e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:25.730804 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 198/399] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:25.751924 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe1e4c-cba7-4c57-9c74-f44d01b6e9c3 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:25.756710 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeea3e-267d-4747-b9b0-03a2bf6b4e33 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:25.823942 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c769c-db1d-4d04-b7aa-6468c62e41a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:25.824625 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c769c-db1d-4d04-b7aa-6468c62e41a5 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:25.824898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c769c-db1d-4d04-b7aa-6468c62e41a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:25.825186 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c769c-db1d-4d04-b7aa-6468c62e41a5 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:25.825951 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c769c-db1d-4d04-b7aa-6468c62e41a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:25.826256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c769c-db1d-4d04-b7aa-6468c62e41a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:25.827651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c769c-db1d-4d04-b7aa-6468c62e41a5 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:25.843426 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 202/400] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:25.850430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c769c-db1d-4d04-b7aa-6468c62e41a5 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:25.873987 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeea3e-267d-4747-b9b0-03a2bf6b4e33 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:25.907699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bc359-1200-47f1-a8e8-4524f6ed16e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:25.908598 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bc359-1200-47f1-a8e8-4524f6ed16e8 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:25.908870 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bc359-1200-47f1-a8e8-4524f6ed16e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:25.909135 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bc359-1200-47f1-a8e8-4524f6ed16e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:25.919699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bc359-1200-47f1-a8e8-4524f6ed16e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:25.927886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-531bc359-1200-47f1-a8e8-4524f6ed16e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:25.927886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:25.927886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:25.927886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:25.927886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:25.927886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:25.927886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:25.927886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:25.927886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:25.927886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:25.927886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:25.927886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:25.927886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:25.927886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:25.927886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:25.927886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:25.928822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:25.928822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:25.928822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:25.928822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:25.928822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:25.928822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:25.928822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:25.928822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:25.928822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:25.928822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:25.928822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:25.928822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:25.928822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:25.928822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:25.928822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:25.928822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:25.935077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:25.935077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:25.935077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:25.935077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:25.935077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:25.935077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:25.935077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:25.935077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:25.935077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:25.935077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:25.935077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:25.935077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:25.935077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 199/401] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:47:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:25.939109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bc359-1200-47f1-a8e8-4524f6ed16e8 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:25.965036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c769c-db1d-4d04-b7aa-6468c62e41a5 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:26.000472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d3316-539f-4c12-9f4f-df40a86b928b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:26.001715 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d3316-539f-4c12-9f4f-df40a86b928b None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:26.002235 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d3316-539f-4c12-9f4f-df40a86b928b None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:26.002702 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d3316-539f-4c12-9f4f-df40a86b928b None admin] PATH_INFO: `/v3/groups/7135f4bdb3a34472a3a18426d6749a46` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:26.004143 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d3316-539f-4c12-9f4f-df40a86b928b None admin] RBAC: Authorizing `identity:get_group(group_id=7135f4bdb3a34472a3a18426d6749a46)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:26.005864 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d3316-539f-4c12-9f4f-df40a86b928b None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:26.009691 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 203/402] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 3 09:47:25 2022] GET /identity/v3/groups/7135f4bdb3a34472a3a18426d6749a46 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:26.014595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d3316-539f-4c12-9f4f-df40a86b928b None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:26.041770 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bc359-1200-47f1-a8e8-4524f6ed16e8 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:26.077317 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758a44b-5b91-4db6-b223-f56a97458457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:26.078048 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758a44b-5b91-4db6-b223-f56a97458457 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:26.078285 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758a44b-5b91-4db6-b223-f56a97458457 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:26.078553 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758a44b-5b91-4db6-b223-f56a97458457 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:26.079292 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758a44b-5b91-4db6-b223-f56a97458457 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:26.079590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758a44b-5b91-4db6-b223-f56a97458457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:26.080984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758a44b-5b91-4db6-b223-f56a97458457 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:26.093908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 200/403] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:26.098836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758a44b-5b91-4db6-b223-f56a97458457 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:26.128860 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d3316-539f-4c12-9f4f-df40a86b928b None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:26.176301 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907be2c7-61d4-4230-bd48-521c256d75ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:26.177195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907be2c7-61d4-4230-bd48-521c256d75ea None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:26.177594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907be2c7-61d4-4230-bd48-521c256d75ea None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:26.177893 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907be2c7-61d4-4230-bd48-521c256d75ea None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:26.179672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907be2c7-61d4-4230-bd48-521c256d75ea None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:26.181346 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907be2c7-61d4-4230-bd48-521c256d75ea None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:26.188002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 204/404] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:26 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:26.190945 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907be2c7-61d4-4230-bd48-521c256d75ea None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:26.231348 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758a44b-5b91-4db6-b223-f56a97458457 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:26.287620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a760734-b00a-47aa-8985-4b2881725e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:26.288686 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a760734-b00a-47aa-8985-4b2881725e7e None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:26.289308 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a760734-b00a-47aa-8985-4b2881725e7e None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:26.289896 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a760734-b00a-47aa-8985-4b2881725e7e None admin] PATH_INFO: `/v3/groups/7135f4bdb3a34472a3a18426d6749a46` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:26.291890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a760734-b00a-47aa-8985-4b2881725e7e None admin] RBAC: Authorizing `identity:get_group(group_id=7135f4bdb3a34472a3a18426d6749a46)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:26.293701 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a760734-b00a-47aa-8985-4b2881725e7e None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:26.297511 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 201/405] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 3 09:47:26 2022] GET /identity/v3/groups/7135f4bdb3a34472a3a18426d6749a46 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:26.298244 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853bd0a-9f32-4942-909b-a3c368275b53 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:26.298617 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853bd0a-9f32-4942-909b-a3c368275b53 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:26.298996 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853bd0a-9f32-4942-909b-a3c368275b53 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:26.302212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 202/406] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:26.306146 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fb172-804a-41d4-a617-6ca623b9e9f2 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:26.306727 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fb172-804a-41d4-a617-6ca623b9e9f2 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:26.307891 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fb172-804a-41d4-a617-6ca623b9e9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:26.329470 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-ee9fb172-804a-41d4-a617-6ca623b9e9f2 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:26.330705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-ee9fb172-804a-41d4-a617-6ca623b9e9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:26.341979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907be2c7-61d4-4230-bd48-521c256d75ea None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:26.384300 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec23e7-6832-47be-b6ee-e1d2d5b12cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:26.385967 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec23e7-6832-47be-b6ee-e1d2d5b12cec None admin] REQUEST_METHOD: `PUT` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:26.386440 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec23e7-6832-47be-b6ee-e1d2d5b12cec None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:26.386894 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec23e7-6832-47be-b6ee-e1d2d5b12cec None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5/groups/7135f4bdb3a34472a3a18426d6749a46/roles/9e77c7f209fd4468bcf1b89bfef3c236` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:26.389036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec23e7-6832-47be-b6ee-e1d2d5b12cec None admin] RBAC: Authorizing `identity:create_grant(project_id=8a5cae0345914eccba509f41e0ddf7a5, group_id=7135f4bdb3a34472a3a18426d6749a46, role_id=9e77c7f209fd4468bcf1b89bfef3c236)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:26.391158 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec23e7-6832-47be-b6ee-e1d2d5b12cec None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:26.408619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 203/408] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:47:26.408965 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 205/408] 10.222.0.55 () {58 vars in 1442 bytes} [Tue May 3 09:47:26 2022] PUT /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5/groups/7135f4bdb3a34472a3a18426d6749a46/roles/9e77c7f209fd4468bcf1b89bfef3c236 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:47:26.410736 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fb172-804a-41d4-a617-6ca623b9e9f2 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:26.451692 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec23e7-6832-47be-b6ee-e1d2d5b12cec None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:26.542748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fb172-804a-41d4-a617-6ca623b9e9f2 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:26.582825 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21babb-2910-49e3-a6c7-9dee206e79dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:26.584056 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21babb-2910-49e3-a6c7-9dee206e79dd None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:26.584533 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21babb-2910-49e3-a6c7-9dee206e79dd None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:26.585000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21babb-2910-49e3-a6c7-9dee206e79dd None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:26.587409 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21babb-2910-49e3-a6c7-9dee206e79dd None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:26.589550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21babb-2910-49e3-a6c7-9dee206e79dd None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:26.592469 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 204/409] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:26 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:26.598622 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21babb-2910-49e3-a6c7-9dee206e79dd None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:26.635067 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec23e7-6832-47be-b6ee-e1d2d5b12cec None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:26.678215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4d1f7-e563-422c-85d9-9a4b1591c89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:26.679025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4d1f7-e563-422c-85d9-9a4b1591c89c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:26.679303 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4d1f7-e563-422c-85d9-9a4b1591c89c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:26.679685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4d1f7-e563-422c-85d9-9a4b1591c89c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:26.694374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4d1f7-e563-422c-85d9-9a4b1591c89c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:26.704293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-5ce4d1f7-e563-422c-85d9-9a4b1591c89c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:47:26.704293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:26.704293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:26.704293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:26.704293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:26.704293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:26.704293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:26.704293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:26.704293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:26.704293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:26.704293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:26.704293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:26.704293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:26.704293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:26.704293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:26.704293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:26.705256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:26.705256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:26.705256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:26.705256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:26.705256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:26.705256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:26.705256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:26.705256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:26.705256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:26.705256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:26.705256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:26.705256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:26.705256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:26.705256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:26.705256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:26.705256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:26.706113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:26.706113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:26.706113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:26.706113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:26.706113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:26.706113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:26.706113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:26.706113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:26.706113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:26.706113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:26.706113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:47:26.706113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:26.706712 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 206/410] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:47:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:26.712909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4d1f7-e563-422c-85d9-9a4b1591c89c None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:26.731530 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21babb-2910-49e3-a6c7-9dee206e79dd None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:26.777446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3a32b-9263-4bc8-b316-69205f497e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:26.778368 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3a32b-9263-4bc8-b316-69205f497e58 None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:26.778647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3a32b-9263-4bc8-b316-69205f497e58 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:26.778917 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3a32b-9263-4bc8-b316-69205f497e58 None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5/groups/7135f4bdb3a34472a3a18426d6749a46/roles/cb8032f764644c90a3dc0cb396434d67` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:26.782639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3a32b-9263-4bc8-b316-69205f497e58 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a5cae0345914eccba509f41e0ddf7a5, group_id=7135f4bdb3a34472a3a18426d6749a46, role_id=cb8032f764644c90a3dc0cb396434d67)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:26.784104 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3a32b-9263-4bc8-b316-69205f497e58 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:26.808611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 205/411] 10.222.0.55 () {58 vars in 1442 bytes} [Tue May 3 09:47:26 2022] PUT /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5/groups/7135f4bdb3a34472a3a18426d6749a46/roles/cb8032f764644c90a3dc0cb396434d67 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:47:26.842171 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4d1f7-e563-422c-85d9-9a4b1591c89c None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:26.900225 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2b159-9f28-46d2-af90-d8a14bb388ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:26.900864 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2b159-9f28-46d2-af90-d8a14bb388ea None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:26.901148 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2b159-9f28-46d2-af90-d8a14bb388ea None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:26.901425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2b159-9f28-46d2-af90-d8a14bb388ea None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:26.902224 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2b159-9f28-46d2-af90-d8a14bb388ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:26.902533 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2b159-9f28-46d2-af90-d8a14bb388ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:26.903935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2b159-9f28-46d2-af90-d8a14bb388ea None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:26.917659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 207/412] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:26.923284 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3a32b-9263-4bc8-b316-69205f497e58 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:27.034216 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3a32b-9263-4bc8-b316-69205f497e58 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:27.072890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22b09-cb3a-4ece-882c-af24cf408413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:27.073829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22b09-cb3a-4ece-882c-af24cf408413 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:27.074114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22b09-cb3a-4ece-882c-af24cf408413 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:27.074385 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22b09-cb3a-4ece-882c-af24cf408413 None admin] PATH_INFO: `/v3/groups/861e52401c924736afd78518cf95360e` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:27.076162 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e22b09-cb3a-4ece-882c-af24cf408413 None admin] RBAC: Authorizing `identity:get_group(group_id=861e52401c924736afd78518cf95360e)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:27.077611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e22b09-cb3a-4ece-882c-af24cf408413 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:27.079562 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 206/413] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 3 09:47:26 2022] GET /identity/v3/groups/861e52401c924736afd78518cf95360e => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:27.084638 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2b159-9f28-46d2-af90-d8a14bb388ea None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:27.216423 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2b159-9f28-46d2-af90-d8a14bb388ea None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:27.253624 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aff29f-5647-4290-b35f-0a31af299039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:27.254891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aff29f-5647-4290-b35f-0a31af299039 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:27.255390 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aff29f-5647-4290-b35f-0a31af299039 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:27.255853 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aff29f-5647-4290-b35f-0a31af299039 None admin] PATH_INFO: `/v3/projects/4434afe425d5493fb9f74ff63598d4e4` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:27.257346 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aff29f-5647-4290-b35f-0a31af299039 None admin] RBAC: Authorizing `identity:get_project(project_id=4434afe425d5493fb9f74ff63598d4e4)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:27.260288 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aff29f-5647-4290-b35f-0a31af299039 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:27.262977 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 208/414] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:27 2022] GET /identity/v3/projects/4434afe425d5493fb9f74ff63598d4e4 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:27.269210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22b09-cb3a-4ece-882c-af24cf408413 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:27.395082 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22b09-cb3a-4ece-882c-af24cf408413 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:27.433369 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4b071-12f4-42ed-91b6-f18f1ec2db91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:27.434280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b071-12f4-42ed-91b6-f18f1ec2db91 None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:27.434560 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b071-12f4-42ed-91b6-f18f1ec2db91 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:27.434833 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b071-12f4-42ed-91b6-f18f1ec2db91 None admin] PATH_INFO: `/v3/projects/4434afe425d5493fb9f74ff63598d4e4/groups/861e52401c924736afd78518cf95360e/roles/52d3ad3e32c741938997691c9a909b81` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:27.443071 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4b071-12f4-42ed-91b6-f18f1ec2db91 None admin] RBAC: Authorizing `identity:create_grant(project_id=4434afe425d5493fb9f74ff63598d4e4, group_id=861e52401c924736afd78518cf95360e, role_id=52d3ad3e32c741938997691c9a909b81)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:27.444509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4b071-12f4-42ed-91b6-f18f1ec2db91 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:27.465576 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 207/415] 10.222.0.55 () {58 vars in 1442 bytes} [Tue May 3 09:47:27 2022] PUT /identity/v3/projects/4434afe425d5493fb9f74ff63598d4e4/groups/861e52401c924736afd78518cf95360e/roles/52d3ad3e32c741938997691c9a909b81 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:47:27.922494 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a35d3-b82d-4c6c-bedb-88734237d6ab None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:27.923515 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a35d3-b82d-4c6c-bedb-88734237d6ab None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:27.923995 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a35d3-b82d-4c6c-bedb-88734237d6ab None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:27.925860 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 209/416] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:27.931107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d815bd-ed8e-477f-adca-794f0e208453 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:27.931395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d815bd-ed8e-477f-adca-794f0e208453 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:27.931671 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d815bd-ed8e-477f-adca-794f0e208453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:27.949781 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-c6d815bd-ed8e-477f-adca-794f0e208453 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:27.950973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-c6d815bd-ed8e-477f-adca-794f0e208453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:28.017459 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 208/417] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:28.040467 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a35d3-b82d-4c6c-bedb-88734237d6ab None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:28.165253 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a35d3-b82d-4c6c-bedb-88734237d6ab None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:28.209479 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57033e7f-e226-429f-b96e-d61eb4a3c928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:28.210241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57033e7f-e226-429f-b96e-d61eb4a3c928 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:28.210520 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57033e7f-e226-429f-b96e-d61eb4a3c928 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:28.210888 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57033e7f-e226-429f-b96e-d61eb4a3c928 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:28.229738 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57033e7f-e226-429f-b96e-d61eb4a3c928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:28.237460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-57033e7f-e226-429f-b96e-d61eb4a3c928 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:28.237460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:28.237460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:28.237460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:28.237460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:28.237460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:28.237460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:28.237460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:28.237460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:28.237460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:28.237460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:28.237460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:28.237460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:28.237460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:28.237460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:28.237460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:28.238384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:28.238384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:28.238384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:28.238384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:28.238384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:28.238384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:28.238384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:28.238384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:28.238384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:28.238384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:28.238384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:28.238384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:28.238384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:28.238384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:28.238384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:28.238384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:28.239589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:28.239589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:28.239589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:28.239589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:28.239589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:28.239589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:28.239589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:28.239589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:28.239589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:28.239589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:28.239589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:28.239589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:28.239589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 210/418] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:28.244829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d815bd-ed8e-477f-adca-794f0e208453 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:28.342091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d815bd-ed8e-477f-adca-794f0e208453 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:28.374587 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b1092-4e1c-4a1a-80dc-153401f7e766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:28.375259 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b1092-4e1c-4a1a-80dc-153401f7e766 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:28.375535 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b1092-4e1c-4a1a-80dc-153401f7e766 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:28.375808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b1092-4e1c-4a1a-80dc-153401f7e766 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:28.376556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b1092-4e1c-4a1a-80dc-153401f7e766 None admin] RBAC: Adding query filter params (name=member) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:28.376859 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b1092-4e1c-4a1a-80dc-153401f7e766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:28.378275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b1092-4e1c-4a1a-80dc-153401f7e766 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:28.387135 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 209/419] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:28.392612 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57033e7f-e226-429f-b96e-d61eb4a3c928 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:28.515658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57033e7f-e226-429f-b96e-d61eb4a3c928 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:28.559291 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf0276-ce7b-46d6-9c6d-e50f0f82ef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:28.559950 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf0276-ce7b-46d6-9c6d-e50f0f82ef6f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:28.560259 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf0276-ce7b-46d6-9c6d-e50f0f82ef6f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:28.560504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf0276-ce7b-46d6-9c6d-e50f0f82ef6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:28.645817 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf0276-ce7b-46d6-9c6d-e50f0f82ef6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:28.647276 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf0276-ce7b-46d6-9c6d-e50f0f82ef6f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:28.673738 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cb71b-9fb6-4837-973e-b1660028059c None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:28.674123 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cb71b-9fb6-4837-973e-b1660028059c None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:28.674310 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cb71b-9fb6-4837-973e-b1660028059c None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:28.675810 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 210/420] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:47:28.682248 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efd2e9-689e-4fd0-a9d5-8d223743a25b None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:28.682589 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efd2e9-689e-4fd0-a9d5-8d223743a25b None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:28.682860 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efd2e9-689e-4fd0-a9d5-8d223743a25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:28.701819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-b2efd2e9-689e-4fd0-a9d5-8d223743a25b None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:28.703368 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-b2efd2e9-689e-4fd0-a9d5-8d223743a25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:28.792518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 211/421] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:28.798420 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf0276-ce7b-46d6-9c6d-e50f0f82ef6f None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:28.839595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 211/422] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:28.924714 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efd2e9-689e-4fd0-a9d5-8d223743a25b None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:28.933315 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf0276-ce7b-46d6-9c6d-e50f0f82ef6f None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:28.973249 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53348a9-47ca-4c1a-97df-b7f8226936b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:28.975770 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53348a9-47ca-4c1a-97df-b7f8226936b4 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:28.976050 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53348a9-47ca-4c1a-97df-b7f8226936b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:28.976310 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53348a9-47ca-4c1a-97df-b7f8226936b4 None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:28.981448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53348a9-47ca-4c1a-97df-b7f8226936b4 None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:28.984378 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53348a9-47ca-4c1a-97df-b7f8226936b4 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:28.987322 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 212/423] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:28 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:28.991789 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53348a9-47ca-4c1a-97df-b7f8226936b4 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:29.113840 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efd2e9-689e-4fd0-a9d5-8d223743a25b None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:29.182930 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53348a9-47ca-4c1a-97df-b7f8226936b4 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:29.188344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a69970-9ac8-4ec6-acbd-89bb9e2bc739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:29.190151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a69970-9ac8-4ec6-acbd-89bb9e2bc739 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:29.193862 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a69970-9ac8-4ec6-acbd-89bb9e2bc739 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:29.194348 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a69970-9ac8-4ec6-acbd-89bb9e2bc739 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:29.219673 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a69970-9ac8-4ec6-acbd-89bb9e2bc739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:29.232207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-51a69970-9ac8-4ec6-acbd-89bb9e2bc739 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:29.232207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:29.232207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:29.232207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:29.232207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:29.232207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:29.232207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:29.232207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:29.232207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:29.232207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:29.232207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:29.232207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:29.232207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:29.232207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:29.232207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:29.232207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:29.233240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:29.233240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:29.233240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:29.233240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:29.233240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:29.233240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:29.233240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:29.233240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:29.233240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:29.233240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:29.233240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:29.233240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:29.233240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:29.233240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:29.233240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:29.233240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:29.234076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:29.234076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:29.234076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:29.234076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:29.234076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:29.234076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:29.234076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:29.234076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:29.234076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:29.234076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:29.234076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:29.234076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:29.234076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 212/424] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:47:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:29.241155 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a69970-9ac8-4ec6-acbd-89bb9e2bc739 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:29.262574 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84965ba-aa4e-41a1-82e1-bebe6cd80e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:29.263813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84965ba-aa4e-41a1-82e1-bebe6cd80e3f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:29.264287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84965ba-aa4e-41a1-82e1-bebe6cd80e3f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:29.264774 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84965ba-aa4e-41a1-82e1-bebe6cd80e3f None admin] PATH_INFO: `/v3/groups/7135f4bdb3a34472a3a18426d6749a46` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:29.266160 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84965ba-aa4e-41a1-82e1-bebe6cd80e3f None admin] RBAC: Authorizing `identity:get_group(group_id=7135f4bdb3a34472a3a18426d6749a46)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:29.267816 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84965ba-aa4e-41a1-82e1-bebe6cd80e3f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:29.271886 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 213/425] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 3 09:47:28 2022] GET /identity/v3/groups/7135f4bdb3a34472a3a18426d6749a46 => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:29.283097 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84965ba-aa4e-41a1-82e1-bebe6cd80e3f None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:29.404608 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a69970-9ac8-4ec6-acbd-89bb9e2bc739 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:29.431469 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84965ba-aa4e-41a1-82e1-bebe6cd80e3f None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:29.447158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140327bb-cdc8-4268-a461-0f0145430fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:29.447999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140327bb-cdc8-4268-a461-0f0145430fba None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:29.448379 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140327bb-cdc8-4268-a461-0f0145430fba None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:29.448751 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140327bb-cdc8-4268-a461-0f0145430fba None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:29.449614 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140327bb-cdc8-4268-a461-0f0145430fba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:29.450064 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140327bb-cdc8-4268-a461-0f0145430fba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:29.451563 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140327bb-cdc8-4268-a461-0f0145430fba None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:29.462609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 213/426] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:29.464203 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71262e-80b0-4093-bf37-766f04493c00 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:29.464586 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71262e-80b0-4093-bf37-766f04493c00 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:29.464954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71262e-80b0-4093-bf37-766f04493c00 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:29.466362 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 214/427] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:29.471546 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71262e-80b0-4093-bf37-766f04493c00 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:29.483360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9f27d-c5bf-4b52-a345-11bf9fa39302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:29.484741 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9f27d-c5bf-4b52-a345-11bf9fa39302 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:29.485185 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9f27d-c5bf-4b52-a345-11bf9fa39302 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:29.485618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9f27d-c5bf-4b52-a345-11bf9fa39302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:29.487364 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9f27d-c5bf-4b52-a345-11bf9fa39302 None admin] RBAC: Adding query filter params (group.id=7135f4bdb3a34472a3a18426d6749a46, role.id=9e77c7f209fd4468bcf1b89bfef3c236, scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:29.487673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9f27d-c5bf-4b52-a345-11bf9fa39302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:29.489323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9f27d-c5bf-4b52-a345-11bf9fa39302 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:29.499440 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 214/428] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 3 09:47:29 2022] GET /identity/v3/role_assignments?group.id=7135f4bdb3a34472a3a18426d6749a46&scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e&role.id=9e77c7f209fd4468bcf1b89bfef3c236 => generated 611 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:29.501715 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b684ab-a796-4470-9e00-ea16b59a1685 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:29.502195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b684ab-a796-4470-9e00-ea16b59a1685 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:29.502883 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b684ab-a796-4470-9e00-ea16b59a1685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:29.525693 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-41b684ab-a796-4470-9e00-ea16b59a1685 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:29.527592 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-41b684ab-a796-4470-9e00-ea16b59a1685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:29.598814 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71262e-80b0-4093-bf37-766f04493c00 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:29.604378 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 215/429] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:29.606059 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8448-8962-4451-aea0-52ac41db1db5 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:29.606473 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8448-8962-4451-aea0-52ac41db1db5 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:29.606862 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8448-8962-4451-aea0-52ac41db1db5 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:29.608288 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 216/430] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:29.614444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53607eee-cd81-4380-bbc8-eac24fef5585 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:29.615015 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53607eee-cd81-4380-bbc8-eac24fef5585 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:29.615480 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53607eee-cd81-4380-bbc8-eac24fef5585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:29.645478 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-53607eee-cd81-4380-bbc8-eac24fef5585 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:29.647520 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-53607eee-cd81-4380-bbc8-eac24fef5585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:29.659329 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1e036-dc5c-43b8-bbef-908d02a4bc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:29.660721 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1e036-dc5c-43b8-bbef-908d02a4bc2b None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:29.661212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1e036-dc5c-43b8-bbef-908d02a4bc2b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:29.662014 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1e036-dc5c-43b8-bbef-908d02a4bc2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:29.724406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 217/431] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:29.730005 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53607eee-cd81-4380-bbc8-eac24fef5585 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:29.750081 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1e036-dc5c-43b8-bbef-908d02a4bc2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:29.751541 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1e036-dc5c-43b8-bbef-908d02a4bc2b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:29.847874 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53607eee-cd81-4380-bbc8-eac24fef5585 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:29.880235 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 215/432] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:29.881401 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1e036-dc5c-43b8-bbef-908d02a4bc2b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:29.889283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c78029-ac64-47ad-b68d-4cc8b40b6b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:29.890146 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c78029-ac64-47ad-b68d-4cc8b40b6b98 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:29.890428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c78029-ac64-47ad-b68d-4cc8b40b6b98 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:29.890711 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c78029-ac64-47ad-b68d-4cc8b40b6b98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:29.911614 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c78029-ac64-47ad-b68d-4cc8b40b6b98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:29.920374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-86c78029-ac64-47ad-b68d-4cc8b40b6b98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:29.920374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:29.920374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:29.920374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:29.920374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:29.920374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:29.920374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:29.920374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:29.920374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:29.920374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:29.920374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:29.920374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:29.920374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:29.920374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:29.920374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:29.920374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:29.921302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:29.921302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:29.921302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:29.921302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:29.921302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:29.921302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:29.921302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:29.921302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:29.921302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:29.921302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:29.921302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:29.921302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:29.921302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:29.921302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:29.921302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:29.921302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:29.922175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:29.922175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:29.922175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:29.922175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:29.922175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:29.922175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:29.922175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:29.922175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:29.922175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:29.922175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:29.922175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 09:47:29.922175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:29.922175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 218/433] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:29.923744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c78029-ac64-47ad-b68d-4cc8b40b6b98 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:30.001844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1e036-dc5c-43b8-bbef-908d02a4bc2b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:30.037375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8592e5-b8f6-4fd5-adc6-bfeffb2a03de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:30.038221 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8592e5-b8f6-4fd5-adc6-bfeffb2a03de None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:30.038501 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8592e5-b8f6-4fd5-adc6-bfeffb2a03de None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:30.038774 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8592e5-b8f6-4fd5-adc6-bfeffb2a03de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:30.049017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8592e5-b8f6-4fd5-adc6-bfeffb2a03de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:30.050754 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c78029-ac64-47ad-b68d-4cc8b40b6b98 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:30.057109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-ac8592e5-b8f6-4fd5-adc6-bfeffb2a03de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:30.057109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:30.057109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:30.057109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:30.057109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:30.057109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:30.057109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:30.057109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:30.057109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:30.057109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:30.057109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:30.057109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:30.057109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:30.057109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:30.057109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:30.057109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:30.058015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:30.058015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:30.058015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:30.058015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:30.058015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:30.058015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:30.058015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:30.058015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:30.058015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:30.058015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:30.058015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:30.058015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:30.058015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:30.058015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:30.058015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:30.058015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:30.059257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:30.059257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:30.059257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:30.059257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:30.059257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:30.059257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:30.059257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:30.059257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:30.059257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:30.059257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:30.059257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:30.059257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:30.059257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 216/434] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:47:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:30.060109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8592e5-b8f6-4fd5-adc6-bfeffb2a03de None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:30.089420 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffd622-f590-4ed3-b417-dec00a8d0b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:30.090320 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffd622-f590-4ed3-b417-dec00a8d0b06 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:30.090603 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffd622-f590-4ed3-b417-dec00a8d0b06 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:30.090877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffd622-f590-4ed3-b417-dec00a8d0b06 None admin] PATH_INFO: `/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:30.092058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffd622-f590-4ed3-b417-dec00a8d0b06 None admin] RBAC: Authorizing `identity:get_project(project_id=eeb6e6402b314d21a8beef0b41fcae2e)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:30.093504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffd622-f590-4ed3-b417-dec00a8d0b06 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:30.095225 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 219/435] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:29 2022] GET /identity/v3/projects/eeb6e6402b314d21a8beef0b41fcae2e => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:30.095975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffd622-f590-4ed3-b417-dec00a8d0b06 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:30.169511 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8592e5-b8f6-4fd5-adc6-bfeffb2a03de None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:30.193944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffd622-f590-4ed3-b417-dec00a8d0b06 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:30.206667 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a645b4-44fa-4537-83fe-5e5820da365a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:30.207337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a645b4-44fa-4537-83fe-5e5820da365a None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:30.207621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a645b4-44fa-4537-83fe-5e5820da365a None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:30.207903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a645b4-44fa-4537-83fe-5e5820da365a None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:30.208655 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a645b4-44fa-4537-83fe-5e5820da365a None admin] RBAC: Adding query filter params (name=member) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:30.208966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a645b4-44fa-4537-83fe-5e5820da365a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:30.210382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a645b4-44fa-4537-83fe-5e5820da365a None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:30.219192 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 217/436] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:47:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:30.219945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a645b4-44fa-4537-83fe-5e5820da365a None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:30.236839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964e9ce-933f-451e-9b63-b1d1ca95bb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:30.237777 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964e9ce-933f-451e-9b63-b1d1ca95bb0b None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:30.238088 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964e9ce-933f-451e-9b63-b1d1ca95bb0b None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:30.238359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964e9ce-933f-451e-9b63-b1d1ca95bb0b None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:30.239105 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964e9ce-933f-451e-9b63-b1d1ca95bb0b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:30.239410 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964e9ce-933f-451e-9b63-b1d1ca95bb0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:30.240774 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964e9ce-933f-451e-9b63-b1d1ca95bb0b None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:30.250269 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 220/437] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:30.251513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964e9ce-933f-451e-9b63-b1d1ca95bb0b None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:30.324820 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a645b4-44fa-4537-83fe-5e5820da365a None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:30.356601 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964e9ce-933f-451e-9b63-b1d1ca95bb0b None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:30.360295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208567c-00a8-4b32-88db-adbc81f05075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:30.361173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208567c-00a8-4b32-88db-adbc81f05075 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:30.361449 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208567c-00a8-4b32-88db-adbc81f05075 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:30.361716 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208567c-00a8-4b32-88db-adbc81f05075 None admin] PATH_INFO: `/v3/groups/7135f4bdb3a34472a3a18426d6749a46` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:30.363029 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208567c-00a8-4b32-88db-adbc81f05075 None admin] RBAC: Authorizing `identity:get_group(group_id=7135f4bdb3a34472a3a18426d6749a46)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:30.364517 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208567c-00a8-4b32-88db-adbc81f05075 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:30.366320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 218/438] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 3 09:47:30 2022] GET /identity/v3/groups/7135f4bdb3a34472a3a18426d6749a46 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:30.367249 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208567c-00a8-4b32-88db-adbc81f05075 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:30.396994 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5ca62-0619-499e-9d77-8acde541203c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:30.398004 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5ca62-0619-499e-9d77-8acde541203c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:30.398518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5ca62-0619-499e-9d77-8acde541203c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:30.398788 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5ca62-0619-499e-9d77-8acde541203c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:30.462816 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208567c-00a8-4b32-88db-adbc81f05075 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:30.466535 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5ca62-0619-499e-9d77-8acde541203c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:30.467990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5ca62-0619-499e-9d77-8acde541203c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:30.494945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42347d-ded3-41b6-ac92-4f363189a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:30.495833 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42347d-ded3-41b6-ac92-4f363189a516 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:30.496118 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42347d-ded3-41b6-ac92-4f363189a516 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:30.496393 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42347d-ded3-41b6-ac92-4f363189a516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:30.565539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42347d-ded3-41b6-ac92-4f363189a516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:30.567076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42347d-ded3-41b6-ac92-4f363189a516 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:30.570861 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 221/439] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:30.572111 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5ca62-0619-499e-9d77-8acde541203c None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:30.662942 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 219/440] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:30.663380 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5ca62-0619-499e-9d77-8acde541203c None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:30.664289 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8c074-7e19-4786-a954-af182daea01c None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:30.664745 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8c074-7e19-4786-a954-af182daea01c None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:30.665017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8c074-7e19-4786-a954-af182daea01c None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:30.666467 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 220/441] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:30.667021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8c074-7e19-4786-a954-af182daea01c None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:30.702639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf757d4-c808-4eb5-8075-bc1579bb63a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:30.703296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf757d4-c808-4eb5-8075-bc1579bb63a4 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:30.703574 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf757d4-c808-4eb5-8075-bc1579bb63a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:30.703818 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf757d4-c808-4eb5-8075-bc1579bb63a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:30.704643 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf757d4-c808-4eb5-8075-bc1579bb63a4 None admin] RBAC: Adding query filter params (group.id=7135f4bdb3a34472a3a18426d6749a46, role.id=cb8032f764644c90a3dc0cb396434d67, scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:30.704948 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf757d4-c808-4eb5-8075-bc1579bb63a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:30.706401 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf757d4-c808-4eb5-8075-bc1579bb63a4 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:30.712045 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 222/442] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 3 09:47:30 2022] GET /identity/v3/role_assignments?group.id=7135f4bdb3a34472a3a18426d6749a46&scope.project.id=eeb6e6402b314d21a8beef0b41fcae2e&role.id=cb8032f764644c90a3dc0cb396434d67 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:30.712802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf757d4-c808-4eb5-8075-bc1579bb63a4 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:30.775959 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8c074-7e19-4786-a954-af182daea01c None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:30.811192 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8608d-d717-4e7e-868b-2db622ff1243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:30.812049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8608d-d717-4e7e-868b-2db622ff1243 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:30.812323 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8608d-d717-4e7e-868b-2db622ff1243 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:30.812589 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8608d-d717-4e7e-868b-2db622ff1243 None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:30.813262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf757d4-c808-4eb5-8075-bc1579bb63a4 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:30.813862 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8608d-d717-4e7e-868b-2db622ff1243 None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:30.815336 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8608d-d717-4e7e-868b-2db622ff1243 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:30.821695 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 221/443] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:30 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:30.821695 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e035e7e-5a93-41dc-a4e4-a03e926d4e97 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:30.821695 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e035e7e-5a93-41dc-a4e4-a03e926d4e97 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:30.821695 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e035e7e-5a93-41dc-a4e4-a03e926d4e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:30.838481 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-0e035e7e-5a93-41dc-a4e4-a03e926d4e97 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:30.839716 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-0e035e7e-5a93-41dc-a4e4-a03e926d4e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:30.849408 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fd4f8-a832-4f39-b9a8-3df46249ff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:30.850317 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fd4f8-a832-4f39-b9a8-3df46249ff7c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:30.850590 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fd4f8-a832-4f39-b9a8-3df46249ff7c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:30.850857 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fd4f8-a832-4f39-b9a8-3df46249ff7c None admin] PATH_INFO: `/v3/projects/8a5cae0345914eccba509f41e0ddf7a5` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:30.852159 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fd4f8-a832-4f39-b9a8-3df46249ff7c None admin] RBAC: Authorizing `identity:get_project(project_id=8a5cae0345914eccba509f41e0ddf7a5)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:30.853629 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fd4f8-a832-4f39-b9a8-3df46249ff7c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:30.855408 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 223/444] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:30 2022] GET /identity/v3/projects/8a5cae0345914eccba509f41e0ddf7a5 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:30.856201 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fd4f8-a832-4f39-b9a8-3df46249ff7c None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:30.916528 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 222/445] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:30.917391 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e035e7e-5a93-41dc-a4e4-a03e926d4e97 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:30.963562 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fd4f8-a832-4f39-b9a8-3df46249ff7c None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:30.999499 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6eaac-fc98-479f-baa1-596924c8241f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:31.000352 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6eaac-fc98-479f-baa1-596924c8241f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:31.000638 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6eaac-fc98-479f-baa1-596924c8241f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:31.000912 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6eaac-fc98-479f-baa1-596924c8241f None admin] PATH_INFO: `/v3/groups/7135f4bdb3a34472a3a18426d6749a46` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:31.002115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6eaac-fc98-479f-baa1-596924c8241f None admin] RBAC: Authorizing `identity:get_group(group_id=7135f4bdb3a34472a3a18426d6749a46)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:31.003571 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6eaac-fc98-479f-baa1-596924c8241f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:31.005185 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 224/446] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 3 09:47:30 2022] GET /identity/v3/groups/7135f4bdb3a34472a3a18426d6749a46 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:31.006601 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6eaac-fc98-479f-baa1-596924c8241f None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:31.020088 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e035e7e-5a93-41dc-a4e4-a03e926d4e97 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:31.059691 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7da2ad-8389-4160-a314-4097fad870a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:31.060551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7da2ad-8389-4160-a314-4097fad870a2 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:31.060826 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7da2ad-8389-4160-a314-4097fad870a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:31.061094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7da2ad-8389-4160-a314-4097fad870a2 None admin] PATH_INFO: `/v3/groups/7135f4bdb3a34472a3a18426d6749a46` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:31.063062 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7da2ad-8389-4160-a314-4097fad870a2 None admin] RBAC: Authorizing `identity:get_group(group_id=7135f4bdb3a34472a3a18426d6749a46)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:31.064641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7da2ad-8389-4160-a314-4097fad870a2 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:31.066657 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 223/447] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 3 09:47:30 2022] GET /identity/v3/groups/7135f4bdb3a34472a3a18426d6749a46 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:31.066657 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7da2ad-8389-4160-a314-4097fad870a2 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:31.122904 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6eaac-fc98-479f-baa1-596924c8241f None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:31.154393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8e2a4-0664-46e7-8766-29e2feeedf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:31.155172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8e2a4-0664-46e7-8766-29e2feeedf4b None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:31.155445 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8e2a4-0664-46e7-8766-29e2feeedf4b None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:31.155706 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8e2a4-0664-46e7-8766-29e2feeedf4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:31.165368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8e2a4-0664-46e7-8766-29e2feeedf4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:31.165506 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7da2ad-8389-4160-a314-4097fad870a2 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:31.172840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-1dd8e2a4-0664-46e7-8766-29e2feeedf4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:47:31.172840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:31.172840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:31.172840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:31.172840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:31.172840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:31.172840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:31.172840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:31.172840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:31.172840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:31.172840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:31.172840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:31.172840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:31.172840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:31.172840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:31.172840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:31.173729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:31.173729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:31.173729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:31.173729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:31.173729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:31.173729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:31.173729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:31.173729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:31.173729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:31.173729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:31.173729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:31.173729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:31.173729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:31.173729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:31.173729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:31.173729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:31.174646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:31.174646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:31.174646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:31.174646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:31.174646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:31.174646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:31.174646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:31.174646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:31.174646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:31.174646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:31.174646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:47:31.174646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:31.174646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 225/448] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:47:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:31.175289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8e2a4-0664-46e7-8766-29e2feeedf4b None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:31.201591 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd46b1-b3ae-4938-999c-be5584e770e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:31.202334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd46b1-b3ae-4938-999c-be5584e770e0 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:31.202613 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd46b1-b3ae-4938-999c-be5584e770e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:31.202883 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd46b1-b3ae-4938-999c-be5584e770e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:31.203736 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd46b1-b3ae-4938-999c-be5584e770e0 None admin] RBAC: Adding query filter params (group.id=7135f4bdb3a34472a3a18426d6749a46, role.id=9e77c7f209fd4468bcf1b89bfef3c236, scope.project.id=8a5cae0345914eccba509f41e0ddf7a5) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:31.204040 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd46b1-b3ae-4938-999c-be5584e770e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:31.205445 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd46b1-b3ae-4938-999c-be5584e770e0 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:31.211007 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 224/449] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 3 09:47:31 2022] GET /identity/v3/role_assignments?group.id=7135f4bdb3a34472a3a18426d6749a46&scope.project.id=8a5cae0345914eccba509f41e0ddf7a5&role.id=9e77c7f209fd4468bcf1b89bfef3c236 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:31.211758 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd46b1-b3ae-4938-999c-be5584e770e0 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:31.275236 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8e2a4-0664-46e7-8766-29e2feeedf4b None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:31.310691 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc8788-a883-40b8-b8af-2816b7ce7244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:31.311267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc8788-a883-40b8-b8af-2816b7ce7244 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:31.311545 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc8788-a883-40b8-b8af-2816b7ce7244 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:31.311815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc8788-a883-40b8-b8af-2816b7ce7244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:31.312646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc8788-a883-40b8-b8af-2816b7ce7244 None admin] RBAC: Adding query filter params (group.id=7135f4bdb3a34472a3a18426d6749a46, role.id=cb8032f764644c90a3dc0cb396434d67, scope.project.id=8a5cae0345914eccba509f41e0ddf7a5) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:31.312962 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc8788-a883-40b8-b8af-2816b7ce7244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:31.314461 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc8788-a883-40b8-b8af-2816b7ce7244 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:31.318847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd46b1-b3ae-4938-999c-be5584e770e0 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:31.320649 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 226/450] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 3 09:47:31 2022] GET /identity/v3/role_assignments?group.id=7135f4bdb3a34472a3a18426d6749a46&scope.project.id=8a5cae0345914eccba509f41e0ddf7a5&role.id=cb8032f764644c90a3dc0cb396434d67 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:31.364560 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91694131-4ebc-41a3-b200-09f76c353e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:31.365700 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91694131-4ebc-41a3-b200-09f76c353e5e None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:31.366213 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91694131-4ebc-41a3-b200-09f76c353e5e None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:31.366680 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91694131-4ebc-41a3-b200-09f76c353e5e None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:31.367744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91694131-4ebc-41a3-b200-09f76c353e5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:31.368277 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91694131-4ebc-41a3-b200-09f76c353e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:31.369908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91694131-4ebc-41a3-b200-09f76c353e5e None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:31.379959 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 225/451] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:31.386254 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc8788-a883-40b8-b8af-2816b7ce7244 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:31.493212 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc8788-a883-40b8-b8af-2816b7ce7244 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:31.529533 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfd17a-465b-4734-b81d-dc8989333a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:31.530299 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfd17a-465b-4734-b81d-dc8989333a38 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:31.530576 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfd17a-465b-4734-b81d-dc8989333a38 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:31.530884 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfd17a-465b-4734-b81d-dc8989333a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:31.597573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfd17a-465b-4734-b81d-dc8989333a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:31.598972 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfd17a-465b-4734-b81d-dc8989333a38 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:31.691367 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 227/452] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 09:47:31.697404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91694131-4ebc-41a3-b200-09f76c353e5e None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:31.794334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91694131-4ebc-41a3-b200-09f76c353e5e None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:31.828664 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21896557-8130-470d-a3dd-45500a655022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:31.829510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21896557-8130-470d-a3dd-45500a655022 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:31.829784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21896557-8130-470d-a3dd-45500a655022 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:31.830086 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21896557-8130-470d-a3dd-45500a655022 None admin] PATH_INFO: `/v3/projects/4434afe425d5493fb9f74ff63598d4e4` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:31.831311 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21896557-8130-470d-a3dd-45500a655022 None admin] RBAC: Authorizing `identity:get_project(project_id=4434afe425d5493fb9f74ff63598d4e4)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:31.832733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21896557-8130-470d-a3dd-45500a655022 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:31.834446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 226/453] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:47:31 2022] GET /identity/v3/projects/4434afe425d5493fb9f74ff63598d4e4 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:31.840280 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfd17a-465b-4734-b81d-dc8989333a38 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:31.938230 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfd17a-465b-4734-b81d-dc8989333a38 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:31.971654 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f439d-a20c-40c6-8dd2-d89b5075eb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:31.972481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f439d-a20c-40c6-8dd2-d89b5075eb2b None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:31.972754 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f439d-a20c-40c6-8dd2-d89b5075eb2b None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:31.973023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f439d-a20c-40c6-8dd2-d89b5075eb2b None admin] PATH_INFO: `/v3/groups/861e52401c924736afd78518cf95360e` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:31.974237 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f439d-a20c-40c6-8dd2-d89b5075eb2b None admin] RBAC: Authorizing `identity:get_group(group_id=861e52401c924736afd78518cf95360e)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:31.975661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f439d-a20c-40c6-8dd2-d89b5075eb2b None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:31.977245 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 228/454] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 3 09:47:31 2022] GET /identity/v3/groups/861e52401c924736afd78518cf95360e => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:31.983601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21896557-8130-470d-a3dd-45500a655022 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:32.090576 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21896557-8130-470d-a3dd-45500a655022 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:32.123443 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a054940-1f0c-4db2-bba8-f97b7a0d7845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:32.124071 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a054940-1f0c-4db2-bba8-f97b7a0d7845 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:32.124349 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a054940-1f0c-4db2-bba8-f97b7a0d7845 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:32.124620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a054940-1f0c-4db2-bba8-f97b7a0d7845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:32.125443 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a054940-1f0c-4db2-bba8-f97b7a0d7845 None admin] RBAC: Adding query filter params (group.id=861e52401c924736afd78518cf95360e, role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=4434afe425d5493fb9f74ff63598d4e4) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:32.125749 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a054940-1f0c-4db2-bba8-f97b7a0d7845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:32.127197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a054940-1f0c-4db2-bba8-f97b7a0d7845 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:32.133894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 227/455] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 3 09:47:31 2022] GET /identity/v3/role_assignments?group.id=861e52401c924736afd78518cf95360e&scope.project.id=4434afe425d5493fb9f74ff63598d4e4&role.id=52d3ad3e32c741938997691c9a909b81 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:34.796362 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084029f-5cd8-4c6a-9516-1ff1daf08596 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:34.796882 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084029f-5cd8-4c6a-9516-1ff1daf08596 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:34.796882 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084029f-5cd8-4c6a-9516-1ff1daf08596 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:34.798580 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 229/456] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:34.803982 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deb983-6a07-4074-ab59-206ea2d0d55b None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:34.804406 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deb983-6a07-4074-ab59-206ea2d0d55b None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:34.804703 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deb983-6a07-4074-ab59-206ea2d0d55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:34.835116 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-79deb983-6a07-4074-ab59-206ea2d0d55b None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:34.836393 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-79deb983-6a07-4074-ab59-206ea2d0d55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:34.923836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 228/457] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:47:34.960207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084029f-5cd8-4c6a-9516-1ff1daf08596 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:35.042717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452861c-71d6-46aa-b16d-715380ddc095 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:35.043071 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452861c-71d6-46aa-b16d-715380ddc095 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:35.043272 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452861c-71d6-46aa-b16d-715380ddc095 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:35.046686 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 229/458] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:35.050719 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb671dd-92e7-401e-9247-ac54289d9f0e None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:35.051003 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb671dd-92e7-401e-9247-ac54289d9f0e None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:35.052160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb671dd-92e7-401e-9247-ac54289d9f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:35.088057 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-9cb671dd-92e7-401e-9247-ac54289d9f0e None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:35.089257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-9cb671dd-92e7-401e-9247-ac54289d9f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:35.102519 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084029f-5cd8-4c6a-9516-1ff1daf08596 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:35.166351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33348376-d323-4b52-8658-adf4f2477f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:35.167157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348376-d323-4b52-8658-adf4f2477f90 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:35.167438 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348376-d323-4b52-8658-adf4f2477f90 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:35.167711 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348376-d323-4b52-8658-adf4f2477f90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:35.181507 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33348376-d323-4b52-8658-adf4f2477f90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:35.183000 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33348376-d323-4b52-8658-adf4f2477f90 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:35.201296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 230/459] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:47:35.217802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-33348376-d323-4b52-8658-adf4f2477f90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:35.217802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:35.217802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:35.217802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:35.217802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:35.217802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:35.217802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:35.217802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:35.217802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:35.217802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:35.217802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:35.217802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:35.217802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:35.217802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:35.217802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:35.219728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:35.219728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:35.219728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:35.219728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:35.219728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:35.219728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:35.219728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:35.219728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:35.219728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:35.219728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:35.219728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:35.219728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:35.219728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:35.219728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:35.219728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:35.219728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:35.219728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:35.221737 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:35.221737 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:35.221737 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:35.221737 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:35.221737 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 230/460] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:35.228212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb671dd-92e7-401e-9247-ac54289d9f0e None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:35.271195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33348376-d323-4b52-8658-adf4f2477f90 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:35.340841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb671dd-92e7-401e-9247-ac54289d9f0e None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:35.374251 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e470dd-73e8-4d8b-a7b3-7355e953bda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:35.375156 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e470dd-73e8-4d8b-a7b3-7355e953bda5 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:35.375599 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e470dd-73e8-4d8b-a7b3-7355e953bda5 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:35.376006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e470dd-73e8-4d8b-a7b3-7355e953bda5 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:35.376858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e470dd-73e8-4d8b-a7b3-7355e953bda5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:35.377299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e470dd-73e8-4d8b-a7b3-7355e953bda5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:35.378832 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e470dd-73e8-4d8b-a7b3-7355e953bda5 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:35.395166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33348376-d323-4b52-8658-adf4f2477f90 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:35.397021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 231/461] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:35.398676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae50633-143f-4d72-b5cd-7b8e0c5c1829 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:35.399108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae50633-143f-4d72-b5cd-7b8e0c5c1829 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:35.399521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae50633-143f-4d72-b5cd-7b8e0c5c1829 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:35.400925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 232/462] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:35.405712 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae50633-143f-4d72-b5cd-7b8e0c5c1829 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:35.438009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95d7d3-7696-49dc-ab7e-d9181c6cc704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:35.439147 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95d7d3-7696-49dc-ab7e-d9181c6cc704 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:35.439571 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95d7d3-7696-49dc-ab7e-d9181c6cc704 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:35.440016 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95d7d3-7696-49dc-ab7e-d9181c6cc704 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:35.450803 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95d7d3-7696-49dc-ab7e-d9181c6cc704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:35.452470 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95d7d3-7696-49dc-ab7e-d9181c6cc704 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:35.470626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-5c95d7d3-7696-49dc-ab7e-d9181c6cc704 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:35.470626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:35.470626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:35.470626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:35.470626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:35.470626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:35.470626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:35.470626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:35.470626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:35.470626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:35.470626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:35.470626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:35.470626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:35.470626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:35.470626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:35.471760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:35.471760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:35.471760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:35.471760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:35.471760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:35.471760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:35.471760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:35.471760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:35.471760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:35.471760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:35.471760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:35.471760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:35.471760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:35.471760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:35.471760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:35.471760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:35.471760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:35.472870 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:35.472870 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:35.472870 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:35.472870 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:35.474693 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 231/463] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:35.476121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688bfe5-9b56-45a1-aa6e-022b9b066fc8 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:35.476784 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688bfe5-9b56-45a1-aa6e-022b9b066fc8 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:35.477349 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688bfe5-9b56-45a1-aa6e-022b9b066fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:35.494028 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-d688bfe5-9b56-45a1-aa6e-022b9b066fc8 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:35.495533 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-d688bfe5-9b56-45a1-aa6e-022b9b066fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:35.506932 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae50633-143f-4d72-b5cd-7b8e0c5c1829 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:35.544224 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850a09e-a0f4-4d52-b374-fbc647d11580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:35.544894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850a09e-a0f4-4d52-b374-fbc647d11580 None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:35.545175 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850a09e-a0f4-4d52-b374-fbc647d11580 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:35.545444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850a09e-a0f4-4d52-b374-fbc647d11580 None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:35.546213 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850a09e-a0f4-4d52-b374-fbc647d11580 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:35.547659 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850a09e-a0f4-4d52-b374-fbc647d11580 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:35.571038 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 232/464] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:35.572415 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688bfe5-9b56-45a1-aa6e-022b9b066fc8 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:35.578310 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 233/465] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:47:35 2022] POST /identity/v3/users => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:47:35.619408 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850a09e-a0f4-4d52-b374-fbc647d11580 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:35.732817 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688bfe5-9b56-45a1-aa6e-022b9b066fc8 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:35.781877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850a09e-a0f4-4d52-b374-fbc647d11580 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:35.783743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0e439-faaa-4bb3-9e9b-42abdc894ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:35.785626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0e439-faaa-4bb3-9e9b-42abdc894ba6 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:35.785950 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0e439-faaa-4bb3-9e9b-42abdc894ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:35.786224 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0e439-faaa-4bb3-9e9b-42abdc894ba6 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:35.786969 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0e439-faaa-4bb3-9e9b-42abdc894ba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:35.787273 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0e439-faaa-4bb3-9e9b-42abdc894ba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:35.788684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0e439-faaa-4bb3-9e9b-42abdc894ba6 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:35.804218 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 233/466] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:35.805623 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325bcca-32cb-4211-8da3-abf7023fd2f6 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:35.805929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325bcca-32cb-4211-8da3-abf7023fd2f6 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:35.806247 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325bcca-32cb-4211-8da3-abf7023fd2f6 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:35.807483 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 234/467] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:35.812284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325bcca-32cb-4211-8da3-abf7023fd2f6 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:35.821944 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25280152-39dd-4103-95d1-08a0a2a83644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:35.823523 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25280152-39dd-4103-95d1-08a0a2a83644 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:35.823773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25280152-39dd-4103-95d1-08a0a2a83644 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:35.824078 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25280152-39dd-4103-95d1-08a0a2a83644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:35.837494 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25280152-39dd-4103-95d1-08a0a2a83644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:35.839034 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25280152-39dd-4103-95d1-08a0a2a83644 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:35.857577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-25280152-39dd-4103-95d1-08a0a2a83644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:35.857577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:35.857577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:35.857577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:35.857577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:35.857577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:35.857577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:35.857577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:35.857577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:35.857577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:35.857577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:35.857577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:35.857577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:35.857577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:35.857577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:35.858496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:35.858496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:35.858496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:35.858496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:35.858496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:35.858496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:35.858496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:35.858496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:35.858496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:35.858496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:35.858496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:35.858496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:35.858496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:35.858496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:35.858496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:35.858496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:35.858496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:35.859333 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:35.859333 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:35.859333 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:35.859333 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:35.860076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 234/468] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:35.861325 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0750007-ae63-4a10-ba48-9fa46015c22f None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:35.861652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0750007-ae63-4a10-ba48-9fa46015c22f None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:35.861974 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0750007-ae63-4a10-ba48-9fa46015c22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:35.884177 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-b0750007-ae63-4a10-ba48-9fa46015c22f None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:35.884177 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-b0750007-ae63-4a10-ba48-9fa46015c22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:35.923635 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325bcca-32cb-4211-8da3-abf7023fd2f6 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:35.956919 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb1ced-1e2d-4b4e-a9b1-a6ae4f43b693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:35.957581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb1ced-1e2d-4b4e-a9b1-a6ae4f43b693 None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:35.957688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 235/469] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:35.957886 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb1ced-1e2d-4b4e-a9b1-a6ae4f43b693 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:35.958155 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb1ced-1e2d-4b4e-a9b1-a6ae4f43b693 None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:35.958506 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0750007-ae63-4a10-ba48-9fa46015c22f None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:35.958853 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb1ced-1e2d-4b4e-a9b1-a6ae4f43b693 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:35.960270 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb1ced-1e2d-4b4e-a9b1-a6ae4f43b693 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:36.001402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 235/470] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:47:35 2022] POST /identity/v3/users => generated 248 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:47:36.002279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb1ced-1e2d-4b4e-a9b1-a6ae4f43b693 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:36.090291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0750007-ae63-4a10-ba48-9fa46015c22f None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:36.112712 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb1ced-1e2d-4b4e-a9b1-a6ae4f43b693 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:36.142874 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f315abf-57c2-4a7e-9b9c-71989e419ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:36.144123 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f315abf-57c2-4a7e-9b9c-71989e419ba0 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:36.145038 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f315abf-57c2-4a7e-9b9c-71989e419ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:36.145760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f315abf-57c2-4a7e-9b9c-71989e419ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:36.146769 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f315abf-57c2-4a7e-9b9c-71989e419ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:36.147266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f315abf-57c2-4a7e-9b9c-71989e419ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:36.148911 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f315abf-57c2-4a7e-9b9c-71989e419ba0 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:36.149374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b8903-86cf-4fd2-86e9-7d0185e5bb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:36.150220 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b8903-86cf-4fd2-86e9-7d0185e5bb21 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:36.150493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b8903-86cf-4fd2-86e9-7d0185e5bb21 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:36.150757 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b8903-86cf-4fd2-86e9-7d0185e5bb21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:36.162855 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b8903-86cf-4fd2-86e9-7d0185e5bb21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:36.164402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b8903-86cf-4fd2-86e9-7d0185e5bb21 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:36.165411 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 236/471] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:36.171116 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f315abf-57c2-4a7e-9b9c-71989e419ba0 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:36.187585 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-361b8903-86cf-4fd2-86e9-7d0185e5bb21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:36.187585 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:36.187585 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:36.187585 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:36.187585 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:36.187585 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:36.187585 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:36.187585 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:36.187585 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:36.187585 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:36.187585 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:36.187585 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:36.187585 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:36.187585 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:36.187585 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:36.188534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:36.188534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:36.188534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:36.188534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:36.188534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:36.188534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:36.188534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:36.188534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:36.188534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:36.188534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:36.188534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:36.188534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:36.188534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:36.188534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:36.188534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:36.188534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:36.188534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:36.189405 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:36.189405 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:36.189405 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:36.189405 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:36.189405 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 236/472] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:36.194390 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b8903-86cf-4fd2-86e9-7d0185e5bb21 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:36.312686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b8903-86cf-4fd2-86e9-7d0185e5bb21 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:36.356078 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277acf4-ccc2-4c4d-95e3-8c2e08a52331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:36.357058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277acf4-ccc2-4c4d-95e3-8c2e08a52331 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:36.357471 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277acf4-ccc2-4c4d-95e3-8c2e08a52331 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:36.358493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277acf4-ccc2-4c4d-95e3-8c2e08a52331 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:36.359062 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277acf4-ccc2-4c4d-95e3-8c2e08a52331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:36.359530 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277acf4-ccc2-4c4d-95e3-8c2e08a52331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:36.360850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f315abf-57c2-4a7e-9b9c-71989e419ba0 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:36.361612 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277acf4-ccc2-4c4d-95e3-8c2e08a52331 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:36.378420 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 237/473] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:36.379924 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b4b88-001e-494f-9689-890e27c3f1f0 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:36.380275 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b4b88-001e-494f-9689-890e27c3f1f0 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:36.380612 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b4b88-001e-494f-9689-890e27c3f1f0 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:36.382394 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 238/474] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:36.384997 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b4b88-001e-494f-9689-890e27c3f1f0 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:36.404922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35786854-feba-4656-b747-637d6003458e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:36.405514 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35786854-feba-4656-b747-637d6003458e None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:36.405915 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35786854-feba-4656-b747-637d6003458e None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:36.406192 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35786854-feba-4656-b747-637d6003458e None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:36.406912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35786854-feba-4656-b747-637d6003458e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:36.408344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35786854-feba-4656-b747-637d6003458e None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:36.435477 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 237/475] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:47:36 2022] POST /identity/v3/users => generated 248 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:47:36.437346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a57ff-d4d6-47ca-b413-fb5c0b20e3dc None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:36.437649 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a57ff-d4d6-47ca-b413-fb5c0b20e3dc None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:36.437984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a57ff-d4d6-47ca-b413-fb5c0b20e3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:36.460435 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-e38a57ff-d4d6-47ca-b413-fb5c0b20e3dc None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:36.461972 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-e38a57ff-d4d6-47ca-b413-fb5c0b20e3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:36.522729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b4b88-001e-494f-9689-890e27c3f1f0 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:36.549648 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 238/476] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:36.571167 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f024b-41d0-461c-aa73-65d20078e3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:36.571869 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f024b-41d0-461c-aa73-65d20078e3ec None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:36.572152 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f024b-41d0-461c-aa73-65d20078e3ec None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:36.572429 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f024b-41d0-461c-aa73-65d20078e3ec None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:36.573251 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f024b-41d0-461c-aa73-65d20078e3ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:36.574835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f024b-41d0-461c-aa73-65d20078e3ec None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:36.603893 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a57ff-d4d6-47ca-b413-fb5c0b20e3dc None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:36.606462 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 239/477] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:47:36 2022] POST /identity/v3/users => generated 249 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:47:36.721493 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a57ff-d4d6-47ca-b413-fb5c0b20e3dc None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:36.760141 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0014f58-367d-4f16-83ca-15e7a844c80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:36.760828 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0014f58-367d-4f16-83ca-15e7a844c80b None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:36.761109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0014f58-367d-4f16-83ca-15e7a844c80b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:36.761382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0014f58-367d-4f16-83ca-15e7a844c80b None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:36.762181 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0014f58-367d-4f16-83ca-15e7a844c80b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:36.763565 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0014f58-367d-4f16-83ca-15e7a844c80b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:36.772649 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.sql.core [None req-f0014f58-367d-4f16-83ca-15e7a844c80b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 09:47:36.772649 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 03 09:47:36.772649 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [parameters: {'id': '9f327cec68554adc82ecd46fd931e9d1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 03 09:47:36.772649 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79790) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 09:47:36.789676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-f0014f58-367d-4f16-83ca-15e7a844c80b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 03 09:47:36.789676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:36.789676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 09:47:36.789676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 09:47:36.789676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 09:47:36.789676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 09:47:36.789676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 09:47:36.789676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application result = self._query(query) May 03 09:47:36.789676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 09:47:36.789676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application conn.query(q) May 03 09:47:36.789676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 09:47:36.789676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 09:47:36.789676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 09:47:36.789676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application result.read() May 03 09:47:36.789676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return ref.to_dict() May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 09:47:36.790644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application next(self.gen) May 03 09:47:36.792013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 09:47:36.792013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application yield resource May 03 09:47:36.792013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 09:47:36.792013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application next(self.gen) May 03 09:47:36.792013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 09:47:36.792013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self.session.rollback() May 03 09:47:36.792013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 09:47:36.792013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self.force_reraise() May 03 09:47:36.792013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 09:47:36.792013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise self.value May 03 09:47:36.792013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 09:47:36.792013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 09:47:36.792013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 09:47:36.792013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application session.commit() May 03 09:47:36.792013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 09:47:36.792013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 09:47:36.792013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 09:47:36.793148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._prepare_impl() May 03 09:47:36.793148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 09:47:36.793148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self.session.flush() May 03 09:47:36.793148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 09:47:36.793148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._flush(objects) May 03 09:47:36.793148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 09:47:36.793148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 09:47:36.793148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 09:47:36.793148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application compat.raise_( May 03 09:47:36.793148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 09:47:36.793148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception May 03 09:47:36.793148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 09:47:36.793148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application flush_context.execute() May 03 09:47:36.793148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 09:47:36.793148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rec.execute(self) May 03 09:47:36.793148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 09:47:36.793148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 09:47:36.794049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 09:47:36.794049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 09:47:36.794049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 03 09:47:36.794049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application c = connection._execute_20( May 03 09:47:36.794049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 09:47:36.794049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 09:47:36.794049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 09:47:36.794049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 09:47:36.794049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 09:47:36.794049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 09:47:36.794049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 09:47:36.794049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 09:47:36.794049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 09:47:36.794049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 09:47:36.794049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 09:47:36.794049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception May 03 09:47:36.794863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 09:47:36.794863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 09:47:36.794863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 09:47:36.794863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 09:47:36.794863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 09:47:36.794863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application result = self._query(query) May 03 09:47:36.794863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 09:47:36.794863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application conn.query(q) May 03 09:47:36.794863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 09:47:36.794863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 09:47:36.794863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 09:47:36.794863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application result.read() May 03 09:47:36.794863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 09:47:36.794863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 09:47:36.794863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 09:47:36.794863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 09:47:36.795625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 09:47:36.795625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 09:47:36.795625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 09:47:36.795625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 09:47:36.795625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 09:47:36.795625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 03 09:47:36.795625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [parameters: {'id': '9f327cec68554adc82ecd46fd931e9d1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 03 09:47:36.795625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 09:47:36.795625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:36.795625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:47:36.795625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:36.795625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:36.795625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:36.795625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:36.795625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:36.795625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:36.797909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:36.797909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:36.797909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:36.797909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:36.797909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:36.797909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:36.797909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 03 09:47:36.797909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 03 09:47:36.797909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:36.797909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:36.797909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 03 09:47:36.797909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 03 09:47:36.797909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 09:47:36.797909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 09:47:36.797909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 03 09:47:36.797909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:36.799759 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 239/478] 10.222.0.55 () {60 vars in 1131 bytes} [Tue May 3 09:47:36 2022] POST /identity/v3/roles => generated 144 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:36.799895 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f024b-41d0-461c-aa73-65d20078e3ec None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:36.918477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f024b-41d0-461c-aa73-65d20078e3ec None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:36.952353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0295c7-69ac-44fe-a316-bd65cdefad13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:36.953184 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0295c7-69ac-44fe-a316-bd65cdefad13 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:36.953464 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0295c7-69ac-44fe-a316-bd65cdefad13 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:36.953736 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0295c7-69ac-44fe-a316-bd65cdefad13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:36.965083 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0295c7-69ac-44fe-a316-bd65cdefad13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:36.973290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-aa0295c7-69ac-44fe-a316-bd65cdefad13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:36.973290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:36.973290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:36.973290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:36.973290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:36.973290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:36.973290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:36.973290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:36.973290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:36.973290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:36.973290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:36.973290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:36.973290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:36.973290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:36.973290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:36.973290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:36.974356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:36.974356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:36.974356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:36.974356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:36.974356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:36.974356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:36.974356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:36.974356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:36.974356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:36.974356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:36.974356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:36.974356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:36.974356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:36.974356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:36.974356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:36.974356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:36.975551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:36.975551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:36.975551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:36.975551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:36.975551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:36.975551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:36.975551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:36.975551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:36.975551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:36.975551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:36.975551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 09:47:36.975551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:36.975551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 240/479] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:47:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:36.981412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0014f58-367d-4f16-83ca-15e7a844c80b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:37.079833 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0014f58-367d-4f16-83ca-15e7a844c80b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:37.123842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829636f0-3a1e-4e63-94ec-9b5f9209e7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:37.124847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829636f0-3a1e-4e63-94ec-9b5f9209e7be None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:37.125301 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829636f0-3a1e-4e63-94ec-9b5f9209e7be None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:37.125746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829636f0-3a1e-4e63-94ec-9b5f9209e7be None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:37.126792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829636f0-3a1e-4e63-94ec-9b5f9209e7be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:37.127302 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829636f0-3a1e-4e63-94ec-9b5f9209e7be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:37.128892 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829636f0-3a1e-4e63-94ec-9b5f9209e7be None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:37.139606 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 240/480] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:38.103578 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2ce85-ae13-46f8-96ad-1b4c0a7269a6 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:38.104584 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2ce85-ae13-46f8-96ad-1b4c0a7269a6 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:38.105086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2ce85-ae13-46f8-96ad-1b4c0a7269a6 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:38.106920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 241/481] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:38.111826 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ac021-e6c7-4069-b8eb-f93be54b93fc None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:38.112658 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ac021-e6c7-4069-b8eb-f93be54b93fc None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:38.113149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ac021-e6c7-4069-b8eb-f93be54b93fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:38.134821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-297ac021-e6c7-4069-b8eb-f93be54b93fc None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:38.136335 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-297ac021-e6c7-4069-b8eb-f93be54b93fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:38.220641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 241/482] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:38.256542 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2ce85-ae13-46f8-96ad-1b4c0a7269a6 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:38.387568 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2ce85-ae13-46f8-96ad-1b4c0a7269a6 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:38.429783 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36850cca-6990-40c5-9d6e-7271c04109e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:38.430680 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850cca-6990-40c5-9d6e-7271c04109e5 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:38.430952 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850cca-6990-40c5-9d6e-7271c04109e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:38.431223 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850cca-6990-40c5-9d6e-7271c04109e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:38.442507 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36850cca-6990-40c5-9d6e-7271c04109e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:38.450927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-36850cca-6990-40c5-9d6e-7271c04109e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:38.450927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:38.450927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:38.450927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:38.450927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:38.450927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:38.450927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:38.450927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:38.450927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:38.450927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:38.450927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:38.450927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:38.450927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:38.450927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:38.450927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:38.450927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:38.451846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:38.451846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:38.451846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:38.451846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:38.451846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:38.451846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:38.451846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:38.451846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:38.451846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:38.451846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:38.451846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:38.451846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:38.451846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:38.451846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:38.451846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:38.451846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:38.452722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:38.452722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:38.452722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:38.452722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:38.452722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:38.452722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:38.452722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:38.452722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:38.452722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:38.452722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:38.452722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:38.452722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:38.452722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 242/483] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:38.458081 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ac021-e6c7-4069-b8eb-f93be54b93fc None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:38.569594 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ac021-e6c7-4069-b8eb-f93be54b93fc None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:38.610487 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d7cbe-2177-4a1e-9c92-7509056729ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:38.611476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d7cbe-2177-4a1e-9c92-7509056729ae None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:38.611890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d7cbe-2177-4a1e-9c92-7509056729ae None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:38.612298 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d7cbe-2177-4a1e-9c92-7509056729ae None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:38.613465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d7cbe-2177-4a1e-9c92-7509056729ae None admin] RBAC: Adding query filter params (name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:38.613956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d7cbe-2177-4a1e-9c92-7509056729ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:38.616133 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d7cbe-2177-4a1e-9c92-7509056729ae None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:38.628347 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 242/484] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:47:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:38.635903 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36850cca-6990-40c5-9d6e-7271c04109e5 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:38.759173 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36850cca-6990-40c5-9d6e-7271c04109e5 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:38.797270 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceadf07-c9c7-4f45-8b94-229d6dc2d5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:38.798094 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceadf07-c9c7-4f45-8b94-229d6dc2d5e3 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:38.798371 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceadf07-c9c7-4f45-8b94-229d6dc2d5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:38.798642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceadf07-c9c7-4f45-8b94-229d6dc2d5e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:38.809654 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceadf07-c9c7-4f45-8b94-229d6dc2d5e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:38.811140 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceadf07-c9c7-4f45-8b94-229d6dc2d5e3 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:38.838815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-1ceadf07-c9c7-4f45-8b94-229d6dc2d5e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:38.838815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:38.838815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:38.838815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:38.838815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:38.838815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:38.838815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:38.838815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:38.838815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:38.838815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:38.838815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:38.838815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:38.838815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:38.838815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:38.838815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:38.840827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:38.840827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:38.840827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:38.840827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:38.840827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:38.840827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:38.840827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:38.840827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:38.840827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:38.840827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:38.840827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:38.840827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:38.840827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:38.840827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:38.840827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:38.840827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:38.840827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:38.842982 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:38.842982 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:38.842982 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:38.842982 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:38.842982 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 243/485] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:38.845672 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d7cbe-2177-4a1e-9c92-7509056729ae None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:38.958978 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d7cbe-2177-4a1e-9c92-7509056729ae None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:38.997311 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2514d-eefe-4d5f-ae1e-a18774a385a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:38.998022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2514d-eefe-4d5f-ae1e-a18774a385a4 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:38.998299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2514d-eefe-4d5f-ae1e-a18774a385a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:38.998568 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2514d-eefe-4d5f-ae1e-a18774a385a4 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:38.999295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2514d-eefe-4d5f-ae1e-a18774a385a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:38.999596 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2514d-eefe-4d5f-ae1e-a18774a385a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:39.000966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2514d-eefe-4d5f-ae1e-a18774a385a4 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:39.014021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 243/486] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:39.019092 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceadf07-c9c7-4f45-8b94-229d6dc2d5e3 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:39.129096 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceadf07-c9c7-4f45-8b94-229d6dc2d5e3 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:39.168819 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa0723-a3e3-47d0-a37f-5e7776074344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:39.169627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa0723-a3e3-47d0-a37f-5e7776074344 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:39.169932 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa0723-a3e3-47d0-a37f-5e7776074344 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:39.170209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa0723-a3e3-47d0-a37f-5e7776074344 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:39.181479 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa0723-a3e3-47d0-a37f-5e7776074344 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:39.182959 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa0723-a3e3-47d0-a37f-5e7776074344 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:39.197835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e253d0-f991-4fb7-b2e6-bee60acff3cc None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:39.198510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e253d0-f991-4fb7-b2e6-bee60acff3cc None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:39.198655 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e253d0-f991-4fb7-b2e6-bee60acff3cc None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:39.200331 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 244/487] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:47:39.205971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9ef91-34fa-4701-a5a2-19b080e5f5cd None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:39.206347 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9ef91-34fa-4701-a5a2-19b080e5f5cd None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:39.206524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-56aa0723-a3e3-47d0-a37f-5e7776074344 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 09:47:39.206524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:39.206524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:39.206524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:39.206524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:39.206524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:39.206524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:39.206524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:39.206524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:39.206524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:39.206524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:39.206524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:39.206524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:47:39.206524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:47:39.206524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:47:39.206524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:39.208400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:39.210451 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:39.210451 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:39.210451 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:47:39.210451 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:47:39.210451 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:47:39.210451 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:47:39.210451 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:47:39.210451 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:47:39.210451 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 09:47:39.210451 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:39.211655 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9ef91-34fa-4701-a5a2-19b080e5f5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:39.211829 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 244/488] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 3 09:47:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:39.214294 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa0723-a3e3-47d0-a37f-5e7776074344 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:39.230457 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-47e9ef91-34fa-4701-a5a2-19b080e5f5cd None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:39.232024 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-47e9ef91-34fa-4701-a5a2-19b080e5f5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:39.302648 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 245/489] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:47:39.322825 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa0723-a3e3-47d0-a37f-5e7776074344 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:39.327814 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9ef91-34fa-4701-a5a2-19b080e5f5cd None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:39.423909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737d647-ec17-458c-8cbe-d90d2d4a677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:39.424669 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737d647-ec17-458c-8cbe-d90d2d4a677c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:39.424948 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737d647-ec17-458c-8cbe-d90d2d4a677c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:39.425219 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737d647-ec17-458c-8cbe-d90d2d4a677c None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:39.426095 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737d647-ec17-458c-8cbe-d90d2d4a677c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:39.426403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737d647-ec17-458c-8cbe-d90d2d4a677c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:39.427847 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737d647-ec17-458c-8cbe-d90d2d4a677c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:39.434729 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9ef91-34fa-4701-a5a2-19b080e5f5cd None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:39.467250 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 245/490] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 3 09:47:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:39.468514 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6683a5-b0e5-49c0-ad72-79cdbbb4ef35 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:39.468796 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6683a5-b0e5-49c0-ad72-79cdbbb4ef35 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:39.469062 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6683a5-b0e5-49c0-ad72-79cdbbb4ef35 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:39.470546 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 246/491] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:39.472425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6683a5-b0e5-49c0-ad72-79cdbbb4ef35 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:39.474175 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1188a-0dc3-4a42-b52c-5407ffa2c7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:39.475046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1188a-0dc3-4a42-b52c-5407ffa2c7fe None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:39.475331 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1188a-0dc3-4a42-b52c-5407ffa2c7fe None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:39.475607 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1188a-0dc3-4a42-b52c-5407ffa2c7fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:39.487156 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1188a-0dc3-4a42-b52c-5407ffa2c7fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:39.495412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-e0c1188a-0dc3-4a42-b52c-5407ffa2c7fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:39.495412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:39.495412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:39.495412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:39.495412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:39.495412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:39.495412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:39.495412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:39.495412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:39.495412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:39.495412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:39.495412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:39.495412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:39.495412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:39.495412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:39.495412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:39.497429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:39.497429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:39.497429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:39.497429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:39.497429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:39.497429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:39.497429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:39.497429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:39.497429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:39.497429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:39.497429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:39.497429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:39.497429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:39.497429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:39.497429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:39.497429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:39.499330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:39.499330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:39.499330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:39.499330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:39.499330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:39.499330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:39.499330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:39.499330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:39.499330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:39.499330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:39.499330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:39.499330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:39.499330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 246/492] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:39.505020 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e8436-1f54-4579-a2a8-da79241a68ea None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:39.505020 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e8436-1f54-4579-a2a8-da79241a68ea None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:39.505020 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e8436-1f54-4579-a2a8-da79241a68ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:39.526871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-af1e8436-1f54-4579-a2a8-da79241a68ea None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:39.528563 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-af1e8436-1f54-4579-a2a8-da79241a68ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:39.574172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6683a5-b0e5-49c0-ad72-79cdbbb4ef35 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:39.605089 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 247/493] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:39.606057 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e8436-1f54-4579-a2a8-da79241a68ea None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:39.618386 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f2a68-8ef3-44cb-8811-a09d326cb0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:39.619600 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f2a68-8ef3-44cb-8811-a09d326cb0b2 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:39.620062 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f2a68-8ef3-44cb-8811-a09d326cb0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:39.620827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f2a68-8ef3-44cb-8811-a09d326cb0b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:39.700460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f2a68-8ef3-44cb-8811-a09d326cb0b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:39.701950 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f2a68-8ef3-44cb-8811-a09d326cb0b2 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:39.702064 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e8436-1f54-4579-a2a8-da79241a68ea None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:39.736250 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b1ab6-ae2c-4855-8d05-36aebac0f016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:39.736919 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b1ab6-ae2c-4855-8d05-36aebac0f016 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:39.737194 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b1ab6-ae2c-4855-8d05-36aebac0f016 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:39.737464 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b1ab6-ae2c-4855-8d05-36aebac0f016 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:39.738237 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b1ab6-ae2c-4855-8d05-36aebac0f016 None admin] RBAC: Adding query filter params (name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:39.738539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b1ab6-ae2c-4855-8d05-36aebac0f016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:39.739937 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b1ab6-ae2c-4855-8d05-36aebac0f016 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:39.748911 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 248/494] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:47:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:39.750112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a166b-6474-4caf-898d-40c1f4c588e6 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:39.750395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a166b-6474-4caf-898d-40c1f4c588e6 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:39.750662 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a166b-6474-4caf-898d-40c1f4c588e6 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:39.753911 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 249/495] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:39.753911 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a166b-6474-4caf-898d-40c1f4c588e6 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:39.803680 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 247/496] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:39.804569 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f2a68-8ef3-44cb-8811-a09d326cb0b2 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:39.857635 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a166b-6474-4caf-898d-40c1f4c588e6 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:39.896402 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304667f-4eb8-4522-827d-295a260fd668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:39.897198 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304667f-4eb8-4522-827d-295a260fd668 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:39.897361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f2a68-8ef3-44cb-8811-a09d326cb0b2 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:39.897482 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304667f-4eb8-4522-827d-295a260fd668 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:39.897725 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304667f-4eb8-4522-827d-295a260fd668 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:39.907788 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304667f-4eb8-4522-827d-295a260fd668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:39.915634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-6304667f-4eb8-4522-827d-295a260fd668 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:39.915634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:39.915634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:39.915634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:39.915634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:39.915634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:39.915634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:39.915634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:39.915634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:39.915634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:39.915634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:39.915634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:39.915634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:39.915634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:39.915634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:39.915634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:39.916521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:39.916521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:39.916521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:39.916521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:39.916521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:39.916521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:39.916521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:39.916521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:39.916521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:39.916521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:39.916521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:39.916521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:39.916521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:39.916521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:39.916521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:39.916521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:39.917712 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:39.917712 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:39.917712 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:39.917712 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:39.917712 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:39.917712 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:39.917712 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:39.917712 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:39.917712 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:39.917712 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:39.917712 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:39.917712 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:39.917712 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 250/497] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:39.918647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb799ec-028e-41a7-80bb-7fec38777b88 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:39.918647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb799ec-028e-41a7-80bb-7fec38777b88 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:39.918939 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb799ec-028e-41a7-80bb-7fec38777b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:39.934733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-2bb799ec-028e-41a7-80bb-7fec38777b88 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:39.935889 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-2bb799ec-028e-41a7-80bb-7fec38777b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:39.936513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d95b6-5fa9-47d4-9977-153a54e294a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:39.937298 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d95b6-5fa9-47d4-9977-153a54e294a6 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:39.937576 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d95b6-5fa9-47d4-9977-153a54e294a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:39.937875 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d95b6-5fa9-47d4-9977-153a54e294a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:39.948134 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d95b6-5fa9-47d4-9977-153a54e294a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:39.949520 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d95b6-5fa9-47d4-9977-153a54e294a6 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:39.967785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-656d95b6-5fa9-47d4-9977-153a54e294a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:39.967785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:39.967785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:39.967785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:39.967785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:39.967785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:39.967785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:39.967785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:39.967785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:39.967785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:39.967785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:39.967785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:39.967785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:39.967785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:39.967785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:39.968651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:39.968651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:39.968651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:39.968651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:39.968651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:39.968651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:39.968651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:39.968651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:39.968651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:39.968651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:39.968651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:39.968651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:39.968651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:39.968651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:39.968651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:39.968651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:39.968651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:39.969471 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:39.969471 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:39.969471 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:39.969471 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:39.969471 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 248/498] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:39.970045 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d95b6-5fa9-47d4-9977-153a54e294a6 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:40.013314 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 251/499] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:40.014478 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb799ec-028e-41a7-80bb-7fec38777b88 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:40.078889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d95b6-5fa9-47d4-9977-153a54e294a6 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:40.115343 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268f760-36d4-492a-9776-ef5fc6ee0123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:40.116060 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268f760-36d4-492a-9776-ef5fc6ee0123 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:40.116338 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268f760-36d4-492a-9776-ef5fc6ee0123 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:40.116609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268f760-36d4-492a-9776-ef5fc6ee0123 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:40.120483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb799ec-028e-41a7-80bb-7fec38777b88 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:40.127798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268f760-36d4-492a-9776-ef5fc6ee0123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:40.129368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268f760-36d4-492a-9776-ef5fc6ee0123 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:40.147353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-7268f760-36d4-492a-9776-ef5fc6ee0123 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:40.147353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:40.147353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:40.147353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:40.147353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:40.147353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:40.147353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:40.147353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:40.147353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:40.147353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:40.147353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:40.147353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:40.147353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:40.147353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:40.147353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:40.148312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:40.148312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:40.148312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:40.148312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:40.148312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:40.148312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:40.148312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:40.148312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:40.148312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:40.148312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:40.148312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:40.148312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:40.148312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:40.148312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:40.148312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:40.148312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:40.148312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:40.149144 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:40.149144 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:40.149144 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:40.149144 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:40.154414 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 249/500] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:40.154414 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268f760-36d4-492a-9776-ef5fc6ee0123 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:40.155900 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1bf8a-0567-4187-bed5-62c12b7f495b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:40.156211 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1bf8a-0567-4187-bed5-62c12b7f495b None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:40.156485 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1bf8a-0567-4187-bed5-62c12b7f495b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:40.156753 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1bf8a-0567-4187-bed5-62c12b7f495b None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:40.157488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1bf8a-0567-4187-bed5-62c12b7f495b None admin] RBAC: Adding query filter params (name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:40.157787 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1bf8a-0567-4187-bed5-62c12b7f495b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:40.159173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1bf8a-0567-4187-bed5-62c12b7f495b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:40.167125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 252/501] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:47:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:40.167891 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1bf8a-0567-4187-bed5-62c12b7f495b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:40.248048 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268f760-36d4-492a-9776-ef5fc6ee0123 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:40.265335 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1bf8a-0567-4187-bed5-62c12b7f495b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:40.281144 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f96649-b6b6-4868-bc35-b793f0596c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:40.281838 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f96649-b6b6-4868-bc35-b793f0596c00 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:40.282116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f96649-b6b6-4868-bc35-b793f0596c00 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:40.282391 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f96649-b6b6-4868-bc35-b793f0596c00 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:40.283112 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f96649-b6b6-4868-bc35-b793f0596c00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:40.283441 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f96649-b6b6-4868-bc35-b793f0596c00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:40.284829 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f96649-b6b6-4868-bc35-b793f0596c00 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:40.296980 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 250/502] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:40.298141 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f96649-b6b6-4868-bc35-b793f0596c00 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:40.301347 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7c99c-12c6-4c93-8421-375726b4718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:40.302261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7c99c-12c6-4c93-8421-375726b4718c None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:40.302539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7c99c-12c6-4c93-8421-375726b4718c None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:40.302802 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7c99c-12c6-4c93-8421-375726b4718c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:40.312838 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7c99c-12c6-4c93-8421-375726b4718c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:40.321106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-b0f7c99c-12c6-4c93-8421-375726b4718c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:40.321106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:40.321106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:40.321106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:40.321106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:40.321106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:40.321106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:40.321106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:40.321106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:40.321106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:40.321106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:40.321106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:40.321106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:40.321106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:40.321106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:40.321106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:40.322266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:40.322266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:40.322266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:40.322266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:40.322266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:40.322266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:40.322266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:40.322266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:40.322266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:40.322266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:40.322266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:40.322266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:40.322266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:40.322266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:40.322266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:40.322266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:40.323094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:40.323094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:40.323094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:40.323094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:40.323094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:40.323094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:40.323094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:40.323094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:40.323094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:40.323094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:40.323094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:40.323094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:40.323094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 253/503] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:40.324187 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7c99c-12c6-4c93-8421-375726b4718c None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:40.388917 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f96649-b6b6-4868-bc35-b793f0596c00 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:40.419509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7c99c-12c6-4c93-8421-375726b4718c None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:40.422410 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79153f45-2c16-464a-b220-793050571fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:40.423042 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153f45-2c16-464a-b220-793050571fe0 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:40.423313 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153f45-2c16-464a-b220-793050571fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:40.423579 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153f45-2c16-464a-b220-793050571fe0 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:40.424271 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79153f45-2c16-464a-b220-793050571fe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:40.424565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79153f45-2c16-464a-b220-793050571fe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:40.425933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79153f45-2c16-464a-b220-793050571fe0 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:40.436795 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 251/504] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:40.438021 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be54b4a-609d-4e7b-bcc8-b6bb5cc8d4ff None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:40.438300 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be54b4a-609d-4e7b-bcc8-b6bb5cc8d4ff None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:40.438542 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be54b4a-609d-4e7b-bcc8-b6bb5cc8d4ff None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:40.439757 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 252/505] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:40.440464 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be54b4a-609d-4e7b-bcc8-b6bb5cc8d4ff None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:40.455290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bffe2-1263-4187-9989-87ee3f60aa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:40.455993 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bffe2-1263-4187-9989-87ee3f60aa67 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:40.456270 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bffe2-1263-4187-9989-87ee3f60aa67 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:40.456539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bffe2-1263-4187-9989-87ee3f60aa67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:40.466953 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bffe2-1263-4187-9989-87ee3f60aa67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:40.468466 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bffe2-1263-4187-9989-87ee3f60aa67 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:40.485448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-230bffe2-1263-4187-9989-87ee3f60aa67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:40.485448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:40.485448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:40.485448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:40.485448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:40.485448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:40.485448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:40.485448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:40.485448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:40.485448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:40.485448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:40.485448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:40.485448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:40.485448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:40.485448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:40.486488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:40.486488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:40.486488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:40.486488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:40.486488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:40.486488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:40.486488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:40.486488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:40.486488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:40.486488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:40.486488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:40.486488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:40.486488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:40.486488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:40.486488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:40.486488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:40.486488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:40.487377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:40.487377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:40.487377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:40.487377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:40.487377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 254/506] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:40.487677 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bffe2-1263-4187-9989-87ee3f60aa67 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:40.541019 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be54b4a-609d-4e7b-bcc8-b6bb5cc8d4ff None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:40.571367 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761219a-339d-4039-84a9-e49b85484c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:40.572149 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761219a-339d-4039-84a9-e49b85484c31 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:40.572424 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761219a-339d-4039-84a9-e49b85484c31 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:40.572692 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761219a-339d-4039-84a9-e49b85484c31 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:40.579136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bffe2-1263-4187-9989-87ee3f60aa67 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:40.579798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761219a-339d-4039-84a9-e49b85484c31 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:40.581198 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761219a-339d-4039-84a9-e49b85484c31 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:40.600336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-5761219a-339d-4039-84a9-e49b85484c31 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 09:47:40.600336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:40.600336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:40.600336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:40.600336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:40.600336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:40.600336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:40.600336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:40.600336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:40.600336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:40.600336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:40.600336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:40.600336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:47:40.600336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:47:40.600336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:47:40.600336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:40.601538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:40.602685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:40.602685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:40.602685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:47:40.602685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:47:40.602685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:47:40.602685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:47:40.602685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:47:40.602685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:47:40.602685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 09:47:40.602685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:40.602685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 253/507] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:40.603349 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761219a-339d-4039-84a9-e49b85484c31 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:40.615847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c91cb0-11a3-4732-be60-64edb86dbc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:40.616512 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91cb0-11a3-4732-be60-64edb86dbc42 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:40.616791 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91cb0-11a3-4732-be60-64edb86dbc42 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:40.617093 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91cb0-11a3-4732-be60-64edb86dbc42 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:40.617974 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c91cb0-11a3-4732-be60-64edb86dbc42 None admin] RBAC: Adding query filter params (name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:40.618283 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c91cb0-11a3-4732-be60-64edb86dbc42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:40.619646 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c91cb0-11a3-4732-be60-64edb86dbc42 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:40.627743 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 255/508] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:47:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:40.628742 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3297e37-963e-4e1a-a9d1-97f497e0913e None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:40.629024 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3297e37-963e-4e1a-a9d1-97f497e0913e None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:40.629294 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3297e37-963e-4e1a-a9d1-97f497e0913e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:40.645771 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-c3297e37-963e-4e1a-a9d1-97f497e0913e None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:40.646898 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-c3297e37-963e-4e1a-a9d1-97f497e0913e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:40.704313 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761219a-339d-4039-84a9-e49b85484c31 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:40.709841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 256/509] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:40.729876 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3297e37-963e-4e1a-a9d1-97f497e0913e None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:40.737808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25575bae-a91b-4900-99ea-e14f55970287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:40.738621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25575bae-a91b-4900-99ea-e14f55970287 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:40.738903 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25575bae-a91b-4900-99ea-e14f55970287 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:40.739167 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25575bae-a91b-4900-99ea-e14f55970287 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:40.745680 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25575bae-a91b-4900-99ea-e14f55970287 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:40.747215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25575bae-a91b-4900-99ea-e14f55970287 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:40.762113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-25575bae-a91b-4900-99ea-e14f55970287 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:40.762113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:40.762113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:40.762113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:40.762113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:40.762113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:40.762113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:40.762113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:40.762113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:40.762113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:40.762113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:40.762113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:40.762113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:47:40.762113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:47:40.762113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:47:40.763170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:47:40.763170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:40.763170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:40.763170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:40.763170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:40.763170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:40.763170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:40.763170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:40.763170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:40.763170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:40.763170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:40.763170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:40.763170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:40.763170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:40.763170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:40.763170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:40.763170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:40.764118 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:47:40.764118 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:47:40.764118 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:47:40.764118 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:47:40.764118 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:47:40.764118 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:47:40.764118 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:40.764118 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:40.764118 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 254/510] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:40.764682 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25575bae-a91b-4900-99ea-e14f55970287 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:40.802788 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3297e37-963e-4e1a-a9d1-97f497e0913e None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:40.837814 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d755be-3d6c-4523-9734-d749a6af4f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:40.838491 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d755be-3d6c-4523-9734-d749a6af4f48 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:40.838758 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d755be-3d6c-4523-9734-d749a6af4f48 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:40.839034 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d755be-3d6c-4523-9734-d749a6af4f48 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:40.839755 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d755be-3d6c-4523-9734-d749a6af4f48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:40.840110 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d755be-3d6c-4523-9734-d749a6af4f48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:40.841481 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d755be-3d6c-4523-9734-d749a6af4f48 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:40.853051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 257/511] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:40.853284 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d755be-3d6c-4523-9734-d749a6af4f48 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:40.858076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25575bae-a91b-4900-99ea-e14f55970287 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:40.889900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774072b-8826-478b-832a-90ebdd60f99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:40.890562 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774072b-8826-478b-832a-90ebdd60f99f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:40.890839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774072b-8826-478b-832a-90ebdd60f99f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:40.891107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774072b-8826-478b-832a-90ebdd60f99f None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:40.891936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774072b-8826-478b-832a-90ebdd60f99f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:40.892242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774072b-8826-478b-832a-90ebdd60f99f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:40.893659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774072b-8826-478b-832a-90ebdd60f99f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:40.910014 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 255/512] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 3 09:47:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:40.910754 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774072b-8826-478b-832a-90ebdd60f99f None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:40.948049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d755be-3d6c-4523-9734-d749a6af4f48 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:40.980836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade1941-766d-4450-a49b-42b5f6a28446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:40.981624 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade1941-766d-4450-a49b-42b5f6a28446 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:40.981943 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade1941-766d-4450-a49b-42b5f6a28446 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:40.982209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade1941-766d-4450-a49b-42b5f6a28446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:40.992623 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade1941-766d-4450-a49b-42b5f6a28446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:40.994094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade1941-766d-4450-a49b-42b5f6a28446 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:41.004485 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774072b-8826-478b-832a-90ebdd60f99f None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:41.011017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-bade1941-766d-4450-a49b-42b5f6a28446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:41.011017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:41.011017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:41.011017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:41.011017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:41.011017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:41.011017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:41.011017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:41.011017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:41.011017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:41.011017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:41.011017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:41.011017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:41.011017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:41.011017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:41.011999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:41.011999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:41.011999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:41.011999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:41.011999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:41.011999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:41.011999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:41.011999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:41.011999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:41.011999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:41.011999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:41.011999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:41.011999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:41.011999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:41.011999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:41.011999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:41.011999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:41.017660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:41.017660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:41.017660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:41.017660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:41.017660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 258/513] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:41.017660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade1941-766d-4450-a49b-42b5f6a28446 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:41.037762 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6c308-bd73-45c5-8665-e7f6a5057883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:41.038571 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6c308-bd73-45c5-8665-e7f6a5057883 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:41.038891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6c308-bd73-45c5-8665-e7f6a5057883 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:41.039163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6c308-bd73-45c5-8665-e7f6a5057883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:41.048911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6c308-bd73-45c5-8665-e7f6a5057883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:41.050386 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6c308-bd73-45c5-8665-e7f6a5057883 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:41.068419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-4bf6c308-bd73-45c5-8665-e7f6a5057883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:41.068419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:41.068419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:41.068419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:41.068419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:41.068419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:41.068419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:41.068419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:41.068419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:41.068419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:41.068419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:41.068419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:41.068419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:41.068419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:41.068419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:41.069453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:41.069453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:41.069453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:41.069453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:41.069453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:41.069453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:41.069453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:41.069453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:41.069453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:41.069453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:41.069453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:41.069453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:41.069453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:41.069453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:41.069453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:41.069453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:41.069453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:41.075416 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:41.075416 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:41.075416 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:41.075416 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:41.075416 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 256/514] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:41.075416 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6c308-bd73-45c5-8665-e7f6a5057883 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:41.113182 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade1941-766d-4450-a49b-42b5f6a28446 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:41.146279 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548b60b-65e6-4206-a3ca-daaf1d0860bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:41.146957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548b60b-65e6-4206-a3ca-daaf1d0860bb None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:41.147229 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548b60b-65e6-4206-a3ca-daaf1d0860bb None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:41.147498 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548b60b-65e6-4206-a3ca-daaf1d0860bb None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:41.148319 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548b60b-65e6-4206-a3ca-daaf1d0860bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:41.148604 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548b60b-65e6-4206-a3ca-daaf1d0860bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:41.150066 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548b60b-65e6-4206-a3ca-daaf1d0860bb None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:41.163705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6c308-bd73-45c5-8665-e7f6a5057883 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:41.167142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 259/515] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:47:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:41.167904 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548b60b-65e6-4206-a3ca-daaf1d0860bb None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:41.196505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5a032-476b-4d2e-b6bd-f5bf4f3e6509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:41.197303 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5a032-476b-4d2e-b6bd-f5bf4f3e6509 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:41.197582 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5a032-476b-4d2e-b6bd-f5bf4f3e6509 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:41.197883 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5a032-476b-4d2e-b6bd-f5bf4f3e6509 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:41.204632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5a032-476b-4d2e-b6bd-f5bf4f3e6509 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:41.206096 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5a032-476b-4d2e-b6bd-f5bf4f3e6509 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:41.220289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-36b5a032-476b-4d2e-b6bd-f5bf4f3e6509 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 09:47:41.220289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:41.220289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:41.220289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:41.220289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:41.220289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:41.220289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:41.220289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:41.220289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:41.220289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:41.220289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:41.220289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:41.220289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:47:41.220289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:47:41.220289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:47:41.220289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:41.221166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:41.222360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:41.222360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:41.222360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:47:41.222360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:47:41.222360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:47:41.222360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:47:41.222360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:47:41.222360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:47:41.222360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 09:47:41.222360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:41.222360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 257/516] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:41.222360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5a032-476b-4d2e-b6bd-f5bf4f3e6509 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:41.265842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548b60b-65e6-4206-a3ca-daaf1d0860bb None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:41.298356 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60decfcd-9ce4-40f0-8552-57392754505d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:41.298998 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60decfcd-9ce4-40f0-8552-57392754505d None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:41.299271 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60decfcd-9ce4-40f0-8552-57392754505d None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:41.299539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60decfcd-9ce4-40f0-8552-57392754505d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:41.320708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5a032-476b-4d2e-b6bd-f5bf4f3e6509 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:41.352110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbdb9c-84e1-4683-b4c6-c7913477d48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:41.352752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbdb9c-84e1-4683-b4c6-c7913477d48f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:41.353025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbdb9c-84e1-4683-b4c6-c7913477d48f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:41.353292 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbdb9c-84e1-4683-b4c6-c7913477d48f None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:41.354035 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbdb9c-84e1-4683-b4c6-c7913477d48f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:41.354338 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbdb9c-84e1-4683-b4c6-c7913477d48f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:41.355703 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbdb9c-84e1-4683-b4c6-c7913477d48f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:41.361297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60decfcd-9ce4-40f0-8552-57392754505d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:41.362775 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60decfcd-9ce4-40f0-8552-57392754505d None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:41.366251 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 258/517] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:41.367057 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbdb9c-84e1-4683-b4c6-c7913477d48f None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:41.458626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbdb9c-84e1-4683-b4c6-c7913477d48f None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:41.459715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 260/518] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:41.460593 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60decfcd-9ce4-40f0-8552-57392754505d None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:41.490686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be430fa2-bfaa-4b80-afe0-ed49620467de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:41.491329 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be430fa2-bfaa-4b80-afe0-ed49620467de None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:41.491576 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be430fa2-bfaa-4b80-afe0-ed49620467de None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:41.491888 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be430fa2-bfaa-4b80-afe0-ed49620467de None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:41.492628 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be430fa2-bfaa-4b80-afe0-ed49620467de None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:41.492889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be430fa2-bfaa-4b80-afe0-ed49620467de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:41.494275 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be430fa2-bfaa-4b80-afe0-ed49620467de None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:41.505251 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 259/519] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:41.506050 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be430fa2-bfaa-4b80-afe0-ed49620467de None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:41.561346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60decfcd-9ce4-40f0-8552-57392754505d None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:41.594649 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82b908-2ed5-4c9d-9a15-eeaa7fc7f0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:41.595272 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82b908-2ed5-4c9d-9a15-eeaa7fc7f0f4 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:41.595548 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82b908-2ed5-4c9d-9a15-eeaa7fc7f0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:41.595816 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82b908-2ed5-4c9d-9a15-eeaa7fc7f0f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:41.596625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82b908-2ed5-4c9d-9a15-eeaa7fc7f0f4 None admin] RBAC: Adding query filter params (role.id=779b01e1e2534bfba9971e7000b7c628, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=efb008cfc6424998917da60d72689f55) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:41.596929 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82b908-2ed5-4c9d-9a15-eeaa7fc7f0f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:41.598368 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82b908-2ed5-4c9d-9a15-eeaa7fc7f0f4 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:41.599886 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be430fa2-bfaa-4b80-afe0-ed49620467de None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:41.603825 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 261/520] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:47:41 2022] GET /identity/v3/role_assignments?user.id=efb008cfc6424998917da60d72689f55&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=779b01e1e2534bfba9971e7000b7c628 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:41.604576 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82b908-2ed5-4c9d-9a15-eeaa7fc7f0f4 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:41.639908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79d6ba-70be-4481-926c-75264adc9661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:41.640596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79d6ba-70be-4481-926c-75264adc9661 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:41.640874 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79d6ba-70be-4481-926c-75264adc9661 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:41.641143 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79d6ba-70be-4481-926c-75264adc9661 None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:41.642034 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79d6ba-70be-4481-926c-75264adc9661 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:41.642346 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79d6ba-70be-4481-926c-75264adc9661 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:41.643852 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79d6ba-70be-4481-926c-75264adc9661 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:41.669031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 260/521] 10.222.0.55 () {56 vars in 1139 bytes} [Tue May 3 09:47:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:41.669943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79d6ba-70be-4481-926c-75264adc9661 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:41.719761 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82b908-2ed5-4c9d-9a15-eeaa7fc7f0f4 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:41.756367 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b42388-d380-4cc2-b459-47732bba3ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:41.757174 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b42388-d380-4cc2-b459-47732bba3ef4 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:41.757515 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b42388-d380-4cc2-b459-47732bba3ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:41.758084 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b42388-d380-4cc2-b459-47732bba3ef4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:41.766287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b42388-d380-4cc2-b459-47732bba3ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:41.767756 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b42388-d380-4cc2-b459-47732bba3ef4 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:41.779696 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79d6ba-70be-4481-926c-75264adc9661 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:41.784261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-d0b42388-d380-4cc2-b459-47732bba3ef4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 09:47:41.784261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:41.784261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:41.784261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:41.784261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:41.784261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:41.784261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:41.784261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:41.784261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:41.784261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:41.784261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:41.784261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:41.784261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:47:41.784261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:47:41.784261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:47:41.784261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:41.785167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:41.786114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:41.786114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:41.786114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:47:41.786114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:47:41.786114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:47:41.786114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:47:41.786114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:47:41.786114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:47:41.786114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 09:47:41.786114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:41.791491 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 262/522] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:41.791491 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b42388-d380-4cc2-b459-47732bba3ef4 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:41.815054 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4672d6f-51bd-4119-b2b1-c39e29869919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:41.815846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4672d6f-51bd-4119-b2b1-c39e29869919 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:41.816105 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4672d6f-51bd-4119-b2b1-c39e29869919 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:41.816389 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4672d6f-51bd-4119-b2b1-c39e29869919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:41.826373 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4672d6f-51bd-4119-b2b1-c39e29869919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:41.827794 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4672d6f-51bd-4119-b2b1-c39e29869919 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:41.845215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-e4672d6f-51bd-4119-b2b1-c39e29869919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:41.845215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:41.845215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:41.845215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:41.845215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:41.845215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:41.845215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:41.845215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:41.845215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:41.845215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:41.845215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:41.845215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:41.845215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:41.845215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:41.845215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:41.846296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:41.846296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:41.846296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:41.846296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:41.846296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:41.846296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:41.846296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:41.846296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:41.846296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:41.846296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:41.846296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:41.846296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:41.846296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:41.846296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:41.846296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:41.846296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:41.846296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:41.847168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:41.847168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:41.847168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:41.847168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:41.847168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 261/523] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:41.847616 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4672d6f-51bd-4119-b2b1-c39e29869919 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:41.890983 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b42388-d380-4cc2-b459-47732bba3ef4 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:41.923267 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae648f5-4792-4a24-a0e5-126826fb27d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:41.923955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae648f5-4792-4a24-a0e5-126826fb27d5 None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:41.924226 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae648f5-4792-4a24-a0e5-126826fb27d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:41.924497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae648f5-4792-4a24-a0e5-126826fb27d5 None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:41.925197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae648f5-4792-4a24-a0e5-126826fb27d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:41.926662 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae648f5-4792-4a24-a0e5-126826fb27d5 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:41.945409 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4672d6f-51bd-4119-b2b1-c39e29869919 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:41.954133 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 263/524] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:47:41 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:47:41.954133 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae648f5-4792-4a24-a0e5-126826fb27d5 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:41.981961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0d3fa-470f-4505-ba8b-0a53a38ed86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:41.982710 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0d3fa-470f-4505-ba8b-0a53a38ed86e None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:41.983087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0d3fa-470f-4505-ba8b-0a53a38ed86e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:41.983455 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0d3fa-470f-4505-ba8b-0a53a38ed86e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:42.056284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0d3fa-470f-4505-ba8b-0a53a38ed86e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:42.058002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0d3fa-470f-4505-ba8b-0a53a38ed86e None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:42.068238 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae648f5-4792-4a24-a0e5-126826fb27d5 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:42.103695 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc9c81-5fe3-4d4b-bcd9-f4840fb8562d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:42.104377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc9c81-5fe3-4d4b-bcd9-f4840fb8562d None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:42.104656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc9c81-5fe3-4d4b-bcd9-f4840fb8562d None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:42.104928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc9c81-5fe3-4d4b-bcd9-f4840fb8562d None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:42.105779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc9c81-5fe3-4d4b-bcd9-f4840fb8562d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:42.106132 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc9c81-5fe3-4d4b-bcd9-f4840fb8562d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:42.107707 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc9c81-5fe3-4d4b-bcd9-f4840fb8562d None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:42.147861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 264/525] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 3 09:47:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:42.148606 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc9c81-5fe3-4d4b-bcd9-f4840fb8562d None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:42.160770 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 262/526] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:42.161486 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0d3fa-470f-4505-ba8b-0a53a38ed86e None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:42.252973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc9c81-5fe3-4d4b-bcd9-f4840fb8562d None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:42.261870 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0d3fa-470f-4505-ba8b-0a53a38ed86e None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:42.293814 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e2ff2-0709-4a9f-82ce-7f783e7c71b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:42.293814 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e2ff2-0709-4a9f-82ce-7f783e7c71b7 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:42.293814 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e2ff2-0709-4a9f-82ce-7f783e7c71b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:42.293814 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e2ff2-0709-4a9f-82ce-7f783e7c71b7 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:42.294486 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e2ff2-0709-4a9f-82ce-7f783e7c71b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:42.294486 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e2ff2-0709-4a9f-82ce-7f783e7c71b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:42.294637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e2ff2-0709-4a9f-82ce-7f783e7c71b7 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:42.296415 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496c5bc-14a0-47b4-9153-e149f850e438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:42.297061 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496c5bc-14a0-47b4-9153-e149f850e438 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:42.297340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496c5bc-14a0-47b4-9153-e149f850e438 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:42.297608 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496c5bc-14a0-47b4-9153-e149f850e438 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:42.306877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 265/527] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:42.307789 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e2ff2-0709-4a9f-82ce-7f783e7c71b7 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:42.368165 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496c5bc-14a0-47b4-9153-e149f850e438 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:42.369734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496c5bc-14a0-47b4-9153-e149f850e438 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:42.405053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e2ff2-0709-4a9f-82ce-7f783e7c71b7 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:42.438270 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563c2ab-6203-4b5c-875e-42808657af50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:42.439105 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563c2ab-6203-4b5c-875e-42808657af50 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:42.439383 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563c2ab-6203-4b5c-875e-42808657af50 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:42.439653 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563c2ab-6203-4b5c-875e-42808657af50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:42.450482 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563c2ab-6203-4b5c-875e-42808657af50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:42.452000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563c2ab-6203-4b5c-875e-42808657af50 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:42.468234 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 263/528] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:42.469092 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496c5bc-14a0-47b4-9153-e149f850e438 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:42.469195 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-d563c2ab-6203-4b5c-875e-42808657af50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:42.469195 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:42.469195 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:42.469195 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:42.469195 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:42.469195 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:42.469195 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:42.469195 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:42.469195 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:42.469195 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:42.469195 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:42.469195 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:42.469195 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:42.469195 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:42.469195 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:42.470021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:42.470021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:42.470021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:42.470021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:42.470021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:42.470021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:42.470021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:42.470021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:42.470021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:42.470021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:42.470021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:42.470021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:42.470021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:42.470021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:42.470021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:42.470021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:42.470021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:42.470852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:42.470852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:42.470852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:42.470852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:42.475033 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 266/529] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:42.475960 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563c2ab-6203-4b5c-875e-42808657af50 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:42.564402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496c5bc-14a0-47b4-9153-e149f850e438 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:42.572652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563c2ab-6203-4b5c-875e-42808657af50 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:42.598241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf78aa-5e87-42ce-8b1d-f84235354c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:42.599619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf78aa-5e87-42ce-8b1d-f84235354c39 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:42.599902 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf78aa-5e87-42ce-8b1d-f84235354c39 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:42.600173 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf78aa-5e87-42ce-8b1d-f84235354c39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:42.606100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d3479-0775-4370-ae1a-c70d2a10f198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:42.606964 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d3479-0775-4370-ae1a-c70d2a10f198 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:42.607324 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d3479-0775-4370-ae1a-c70d2a10f198 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:42.607652 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf78aa-5e87-42ce-8b1d-f84235354c39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:42.607793 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d3479-0775-4370-ae1a-c70d2a10f198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:42.609095 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf78aa-5e87-42ce-8b1d-f84235354c39 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:42.622875 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d3479-0775-4370-ae1a-c70d2a10f198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:42.624343 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d3479-0775-4370-ae1a-c70d2a10f198 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:42.624719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-99bf78aa-5e87-42ce-8b1d-f84235354c39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:42.624719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:42.624719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:42.624719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:42.624719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:42.624719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:42.624719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:42.624719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:42.624719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:42.624719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:42.624719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:42.624719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:42.624719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:47:42.624719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:47:42.624719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:47:42.626363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:47:42.626363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:42.626363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:42.626363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:42.626363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:42.626363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:42.626363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:42.626363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:42.626363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:42.626363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:42.626363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:42.626363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:42.626363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:42.626363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:42.626363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:42.626363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:42.626363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:42.628359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:47:42.628359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:47:42.628359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:47:42.628359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:47:42.628359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:47:42.628359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:47:42.628359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:42.628359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:42.638030 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 264/530] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:42.638030 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf78aa-5e87-42ce-8b1d-f84235354c39 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:42.645200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-a49d3479-0775-4370-ae1a-c70d2a10f198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:42.645200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:42.645200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:42.645200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:42.645200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:42.645200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:42.645200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:42.645200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:42.645200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:42.645200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:42.645200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:42.645200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:42.645200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:42.645200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:42.645200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:42.648022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:42.648022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:42.648022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:42.648022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:42.648022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:42.648022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:42.648022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:42.648022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:42.648022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:42.648022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:42.648022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:42.648022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:42.648022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:42.648022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:42.648022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:42.648022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:42.648022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:42.649881 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:42.649881 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:42.649881 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:42.649881 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:42.649881 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 267/531] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:42.649881 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d3479-0775-4370-ae1a-c70d2a10f198 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:42.739657 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf78aa-5e87-42ce-8b1d-f84235354c39 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:42.760452 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d3479-0775-4370-ae1a-c70d2a10f198 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:42.776523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464f9e8-15fd-491e-89ed-525afed754f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:42.777186 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464f9e8-15fd-491e-89ed-525afed754f9 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:42.777460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464f9e8-15fd-491e-89ed-525afed754f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:42.777724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464f9e8-15fd-491e-89ed-525afed754f9 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:42.778468 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464f9e8-15fd-491e-89ed-525afed754f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:42.778764 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464f9e8-15fd-491e-89ed-525afed754f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:42.780213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464f9e8-15fd-491e-89ed-525afed754f9 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:42.792257 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 265/532] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:42.793288 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464f9e8-15fd-491e-89ed-525afed754f9 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:42.794309 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287c34c-3a0c-4f6f-9762-e3efe2a717c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:42.794974 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287c34c-3a0c-4f6f-9762-e3efe2a717c6 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:42.795249 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287c34c-3a0c-4f6f-9762-e3efe2a717c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:42.795531 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287c34c-3a0c-4f6f-9762-e3efe2a717c6 None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:42.796314 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287c34c-3a0c-4f6f-9762-e3efe2a717c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:42.796618 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287c34c-3a0c-4f6f-9762-e3efe2a717c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:42.798153 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287c34c-3a0c-4f6f-9762-e3efe2a717c6 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:42.810937 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 268/533] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:47:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:42.811605 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287c34c-3a0c-4f6f-9762-e3efe2a717c6 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:42.901889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464f9e8-15fd-491e-89ed-525afed754f9 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:42.924436 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287c34c-3a0c-4f6f-9762-e3efe2a717c6 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:42.934937 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e053e8-a2cb-4b16-abff-8a87269a5b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:42.935605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e053e8-a2cb-4b16-abff-8a87269a5b8c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:42.935882 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e053e8-a2cb-4b16-abff-8a87269a5b8c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:42.936156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e053e8-a2cb-4b16-abff-8a87269a5b8c None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:42.936871 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e053e8-a2cb-4b16-abff-8a87269a5b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:42.937170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e053e8-a2cb-4b16-abff-8a87269a5b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:42.938568 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e053e8-a2cb-4b16-abff-8a87269a5b8c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:42.950282 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 266/534] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:42.951125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e053e8-a2cb-4b16-abff-8a87269a5b8c None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:42.964314 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e05545-2543-428f-94a1-e38ce37d0ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:42.965326 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e05545-2543-428f-94a1-e38ce37d0ac4 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:42.965628 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e05545-2543-428f-94a1-e38ce37d0ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:42.965876 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e05545-2543-428f-94a1-e38ce37d0ac4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:42.974845 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e05545-2543-428f-94a1-e38ce37d0ac4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:42.977082 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e05545-2543-428f-94a1-e38ce37d0ac4 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:42.995375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-26e05545-2543-428f-94a1-e38ce37d0ac4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:42.995375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:42.995375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:42.995375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:42.995375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:42.995375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:42.995375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:42.995375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:42.995375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:42.995375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:42.995375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:42.995375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:42.995375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:47:42.995375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:47:42.995375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:47:42.996846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:47:42.996846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:42.996846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:42.996846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:42.996846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:42.996846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:42.996846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:42.996846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:42.996846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:42.996846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:42.996846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:42.996846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:42.996846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:42.996846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:42.996846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:42.996846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:42.996846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:42.998949 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:47:42.998949 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:47:42.998949 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:47:42.998949 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:47:42.998949 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:47:42.998949 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:47:42.998949 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:42.998949 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:42.998949 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 269/535] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:42.998949 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e05545-2543-428f-94a1-e38ce37d0ac4 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:43.056449 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e053e8-a2cb-4b16-abff-8a87269a5b8c None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:43.101697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e05545-2543-428f-94a1-e38ce37d0ac4 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:43.102122 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf887a-92c1-4ca1-9c8f-31c27bfdc4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:43.102779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf887a-92c1-4ca1-9c8f-31c27bfdc4d5 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:43.103141 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf887a-92c1-4ca1-9c8f-31c27bfdc4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:43.103564 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf887a-92c1-4ca1-9c8f-31c27bfdc4d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:43.105191 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf887a-92c1-4ca1-9c8f-31c27bfdc4d5 None admin] RBAC: Adding query filter params (role.id=779b01e1e2534bfba9971e7000b7c628, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=d5b508ac957b4224912fbc2c2f1ea324) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:43.105505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf887a-92c1-4ca1-9c8f-31c27bfdc4d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:43.106957 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf887a-92c1-4ca1-9c8f-31c27bfdc4d5 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:43.117886 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 267/536] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:47:42 2022] GET /identity/v3/role_assignments?user.id=d5b508ac957b4224912fbc2c2f1ea324&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=779b01e1e2534bfba9971e7000b7c628 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:43.118854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf887a-92c1-4ca1-9c8f-31c27bfdc4d5 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:43.167965 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471c61b-753b-4162-8d18-18ded1bd02cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:43.168699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471c61b-753b-4162-8d18-18ded1bd02cf None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:43.168977 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471c61b-753b-4162-8d18-18ded1bd02cf None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:43.169242 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471c61b-753b-4162-8d18-18ded1bd02cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:43.184496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471c61b-753b-4162-8d18-18ded1bd02cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:43.186137 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471c61b-753b-4162-8d18-18ded1bd02cf None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:43.220779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-1471c61b-753b-4162-8d18-18ded1bd02cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:43.220779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:43.220779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:43.220779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:43.220779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:43.220779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:43.220779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:43.220779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:43.220779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:43.220779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:43.220779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:43.220779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:43.220779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:47:43.220779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:47:43.220779 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:47:43.222909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:47:43.222909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:43.222909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:43.222909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:43.222909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:43.222909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:43.222909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:43.222909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:43.222909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:43.222909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:43.222909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:43.222909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:43.222909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:43.222909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:43.222909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:43.222909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:43.222909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:43.224945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:47:43.224945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:47:43.224945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:47:43.224945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:47:43.224945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:47:43.224945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:47:43.224945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:43.224945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:43.229816 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 270/537] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:43.232334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471c61b-753b-4162-8d18-18ded1bd02cf None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:43.308463 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf887a-92c1-4ca1-9c8f-31c27bfdc4d5 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:43.343627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2f08c-36e9-4dae-ab47-38c9dd83d65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:43.344287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2f08c-36e9-4dae-ab47-38c9dd83d65f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:43.344567 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2f08c-36e9-4dae-ab47-38c9dd83d65f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:43.344835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2f08c-36e9-4dae-ab47-38c9dd83d65f None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:43.345645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2f08c-36e9-4dae-ab47-38c9dd83d65f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:43.345952 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2f08c-36e9-4dae-ab47-38c9dd83d65f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:43.349814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2f08c-36e9-4dae-ab47-38c9dd83d65f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:43.366518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 268/538] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:47:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:43.375278 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2f08c-36e9-4dae-ab47-38c9dd83d65f None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:43.412770 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471c61b-753b-4162-8d18-18ded1bd02cf None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:43.466283 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a88a0-8193-43e8-aae9-b0a61264772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:43.467047 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a88a0-8193-43e8-aae9-b0a61264772b None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:43.467331 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a88a0-8193-43e8-aae9-b0a61264772b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:43.467607 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a88a0-8193-43e8-aae9-b0a61264772b None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:43.468396 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a88a0-8193-43e8-aae9-b0a61264772b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:43.468704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a88a0-8193-43e8-aae9-b0a61264772b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:43.470187 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a88a0-8193-43e8-aae9-b0a61264772b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:43.484342 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 271/539] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:47:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:43.489747 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a88a0-8193-43e8-aae9-b0a61264772b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:43.539041 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2f08c-36e9-4dae-ab47-38c9dd83d65f None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:43.585339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a5e89-292c-4901-a0b4-bb4c0ca72c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:43.586391 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5e89-292c-4901-a0b4-bb4c0ca72c59 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:43.586622 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5e89-292c-4901-a0b4-bb4c0ca72c59 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:43.586900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5e89-292c-4901-a0b4-bb4c0ca72c59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:43.587744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a5e89-292c-4901-a0b4-bb4c0ca72c59 None admin] RBAC: Adding query filter params (role.id=779b01e1e2534bfba9971e7000b7c628, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=7eb3d5bb36f445cabb62cacf1b34984d) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:43.588050 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a5e89-292c-4901-a0b4-bb4c0ca72c59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:43.589477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a5e89-292c-4901-a0b4-bb4c0ca72c59 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:43.598293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 269/540] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:47:43 2022] GET /identity/v3/role_assignments?user.id=7eb3d5bb36f445cabb62cacf1b34984d&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=779b01e1e2534bfba9971e7000b7c628 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:43.653583 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a88a0-8193-43e8-aae9-b0a61264772b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:43.698709 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309158f-a8c0-48ae-aa5c-ddd894d0a54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:43.699393 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309158f-a8c0-48ae-aa5c-ddd894d0a54f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:43.699737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309158f-a8c0-48ae-aa5c-ddd894d0a54f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:43.700017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309158f-a8c0-48ae-aa5c-ddd894d0a54f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:43.700863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309158f-a8c0-48ae-aa5c-ddd894d0a54f None admin] RBAC: Adding query filter params (role.id=779b01e1e2534bfba9971e7000b7c628, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=f361b5ebd2b246c4bed5be82a70f63e9) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:43.701172 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309158f-a8c0-48ae-aa5c-ddd894d0a54f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:43.702649 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309158f-a8c0-48ae-aa5c-ddd894d0a54f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:43.709202 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 272/541] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:47:43 2022] GET /identity/v3/role_assignments?user.id=f361b5ebd2b246c4bed5be82a70f63e9&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=779b01e1e2534bfba9971e7000b7c628 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:44.048878 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699351-4a74-44ed-bc36-84295e20e9f4 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:44.049255 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699351-4a74-44ed-bc36-84295e20e9f4 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:44.049421 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699351-4a74-44ed-bc36-84295e20e9f4 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:44.051086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 270/542] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:44.057303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb0286-c60a-4f0c-850c-9be23e71943c None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:44.057592 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb0286-c60a-4f0c-850c-9be23e71943c None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:44.057906 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb0286-c60a-4f0c-850c-9be23e71943c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:44.075667 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-0cfb0286-c60a-4f0c-850c-9be23e71943c None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:44.076837 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-0cfb0286-c60a-4f0c-850c-9be23e71943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:44.151688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 273/543] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:44.173998 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b699351-4a74-44ed-bc36-84295e20e9f4 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:44.299241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b699351-4a74-44ed-bc36-84295e20e9f4 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:44.346753 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fa926-b079-49c7-a5b4-6aecab61976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:44.347557 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fa926-b079-49c7-a5b4-6aecab61976d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:44.347834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fa926-b079-49c7-a5b4-6aecab61976d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:44.348105 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fa926-b079-49c7-a5b4-6aecab61976d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:44.362240 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fa926-b079-49c7-a5b4-6aecab61976d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:44.370036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-901fa926-b079-49c7-a5b4-6aecab61976d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:44.370036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:44.370036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:44.370036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:44.370036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:44.370036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:44.370036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:44.370036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:44.370036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:44.370036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:44.370036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:44.370036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:44.370036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:44.370036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:44.370036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:44.370036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:44.370920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:44.370920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:44.370920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:44.370920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:44.370920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:44.370920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:44.370920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:44.370920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:44.370920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:44.370920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:44.370920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:44.370920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:44.370920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:44.370920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:44.370920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:44.370920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:44.371704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:44.371704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:44.371704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:44.371704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:44.371704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:44.371704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:44.371704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:44.371704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:44.371704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:44.371704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:44.371704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:44.371704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:44.371704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 271/544] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:44.377419 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb0286-c60a-4f0c-850c-9be23e71943c None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:44.474142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb0286-c60a-4f0c-850c-9be23e71943c None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:44.507277 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4a3ad-9ea3-44b3-bd5e-5406d3fce4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:44.508430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4a3ad-9ea3-44b3-bd5e-5406d3fce4c9 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:44.508714 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4a3ad-9ea3-44b3-bd5e-5406d3fce4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:44.508984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4a3ad-9ea3-44b3-bd5e-5406d3fce4c9 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:44.509730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4a3ad-9ea3-44b3-bd5e-5406d3fce4c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:44.510063 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4a3ad-9ea3-44b3-bd5e-5406d3fce4c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:44.511420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4a3ad-9ea3-44b3-bd5e-5406d3fce4c9 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:44.519856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 274/545] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:47:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:44.524576 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02b53c-56c9-4211-a040-be598ce7fe6d None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:44.525090 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02b53c-56c9-4211-a040-be598ce7fe6d None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:44.525344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4a3ad-9ea3-44b3-bd5e-5406d3fce4c9 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:44.525783 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02b53c-56c9-4211-a040-be598ce7fe6d None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:44.527554 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 272/546] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:44.532870 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58d4db-b927-44f7-8587-967a9a6bf6c7 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:44.533408 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58d4db-b927-44f7-8587-967a9a6bf6c7 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:44.533904 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58d4db-b927-44f7-8587-967a9a6bf6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:44.574917 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-2f58d4db-b927-44f7-8587-967a9a6bf6c7 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:44.576450 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-2f58d4db-b927-44f7-8587-967a9a6bf6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:44.623623 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4a3ad-9ea3-44b3-bd5e-5406d3fce4c9 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:44.660137 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a0778-b9a2-4c44-a357-db234a2fc132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:44.660956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a0778-b9a2-4c44-a357-db234a2fc132 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:44.661240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a0778-b9a2-4c44-a357-db234a2fc132 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:44.661753 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a0778-b9a2-4c44-a357-db234a2fc132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:44.673146 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a0778-b9a2-4c44-a357-db234a2fc132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:44.675523 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a0778-b9a2-4c44-a357-db234a2fc132 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:44.694131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-292a0778-b9a2-4c44-a357-db234a2fc132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:44.694131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:44.694131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:44.694131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:44.694131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:44.694131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:44.694131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:44.694131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:44.694131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:44.694131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:44.694131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:44.694131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:44.694131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:44.694131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:44.694131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:44.695209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:44.695209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:44.695209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:44.695209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:44.695209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:44.695209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:44.695209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:44.695209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:44.695209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:44.695209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:44.695209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:44.695209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:44.695209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:44.695209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:44.695209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:44.695209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:44.695209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:44.696138 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:44.696138 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:44.696138 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:44.696138 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:44.696138 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 275/547] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:44.701238 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a0778-b9a2-4c44-a357-db234a2fc132 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:44.764365 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 273/548] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:47:44.803174 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a0778-b9a2-4c44-a357-db234a2fc132 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:44.805859 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58d4db-b927-44f7-8587-967a9a6bf6c7 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:44.860714 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f172c-a0ad-4a94-9d53-324329360314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:44.861720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f172c-a0ad-4a94-9d53-324329360314 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:44.862231 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f172c-a0ad-4a94-9d53-324329360314 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:44.863347 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f172c-a0ad-4a94-9d53-324329360314 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:44.864282 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f172c-a0ad-4a94-9d53-324329360314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:44.865309 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f172c-a0ad-4a94-9d53-324329360314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:44.867121 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f172c-a0ad-4a94-9d53-324329360314 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:44.890883 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 276/549] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:44.897826 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f172c-a0ad-4a94-9d53-324329360314 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:44.994344 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58d4db-b927-44f7-8587-967a9a6bf6c7 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:45.039562 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e603fc-1bbb-4e87-9e56-37dbdb8019ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:45.040421 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e603fc-1bbb-4e87-9e56-37dbdb8019ae None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:45.040739 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e603fc-1bbb-4e87-9e56-37dbdb8019ae None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:45.041017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e603fc-1bbb-4e87-9e56-37dbdb8019ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:45.059699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f172c-a0ad-4a94-9d53-324329360314 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:45.064734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e603fc-1bbb-4e87-9e56-37dbdb8019ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:45.072776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-a2e603fc-1bbb-4e87-9e56-37dbdb8019ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:45.072776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:45.072776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:45.072776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:45.072776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:45.072776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:45.072776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:45.072776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:45.072776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:45.072776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:45.072776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:45.072776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:45.072776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:45.072776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:45.072776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:45.072776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:45.073672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:45.073672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:45.073672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:45.073672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:45.073672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:45.073672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:45.073672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:45.073672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:45.073672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:45.073672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:45.073672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:45.073672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:45.073672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:45.073672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:45.073672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:45.073672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:45.074477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:45.074477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:45.074477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:45.074477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:45.074477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:45.074477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:45.074477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:45.074477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:45.074477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:45.074477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:45.074477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:45.074477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:45.074477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 274/550] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:45.081527 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e603fc-1bbb-4e87-9e56-37dbdb8019ae None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:45.121489 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbd805-9f46-4837-b282-9adac9621317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:45.123349 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbd805-9f46-4837-b282-9adac9621317 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:45.123632 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbd805-9f46-4837-b282-9adac9621317 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:45.123906 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbd805-9f46-4837-b282-9adac9621317 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:45.142964 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbd805-9f46-4837-b282-9adac9621317 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:45.144426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbd805-9f46-4837-b282-9adac9621317 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:45.170000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-aefbd805-9f46-4837-b282-9adac9621317 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 09:47:45.170000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:45.170000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:45.170000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:45.170000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:45.170000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:45.170000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:45.170000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:45.170000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:45.170000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:45.170000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:45.170000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:45.170000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:47:45.170000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:47:45.170000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:47:45.170000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:45.170954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:45.171829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:45.171829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:45.171829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:47:45.171829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:47:45.171829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:47:45.171829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:47:45.171829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:47:45.171829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:47:45.171829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 09:47:45.171829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:45.178223 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 277/551] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 3 09:47:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:45.183668 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbd805-9f46-4837-b282-9adac9621317 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:45.206091 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e603fc-1bbb-4e87-9e56-37dbdb8019ae None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:45.253679 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d5ce4-d6cc-4306-8ccd-baa74eeb95a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:45.254581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d5ce4-d6cc-4306-8ccd-baa74eeb95a9 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:45.254865 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d5ce4-d6cc-4306-8ccd-baa74eeb95a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:45.255143 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d5ce4-d6cc-4306-8ccd-baa74eeb95a9 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:45.255899 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d5ce4-d6cc-4306-8ccd-baa74eeb95a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:45.256212 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d5ce4-d6cc-4306-8ccd-baa74eeb95a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:45.258107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d5ce4-d6cc-4306-8ccd-baa74eeb95a9 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:45.267043 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 275/552] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:47:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:45.274515 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d5ce4-d6cc-4306-8ccd-baa74eeb95a9 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:45.318919 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbd805-9f46-4837-b282-9adac9621317 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:45.355357 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591e2b6-5183-4715-b7a0-8ea690fd6b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:45.356427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591e2b6-5183-4715-b7a0-8ea690fd6b43 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:45.358056 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591e2b6-5183-4715-b7a0-8ea690fd6b43 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:45.358527 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591e2b6-5183-4715-b7a0-8ea690fd6b43 None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:45.360256 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591e2b6-5183-4715-b7a0-8ea690fd6b43 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:45.361164 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591e2b6-5183-4715-b7a0-8ea690fd6b43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:45.363378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591e2b6-5183-4715-b7a0-8ea690fd6b43 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:45.397161 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 278/553] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 3 09:47:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:45.400917 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591e2b6-5183-4715-b7a0-8ea690fd6b43 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:45.458855 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d5ce4-d6cc-4306-8ccd-baa74eeb95a9 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:45.530701 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591e2b6-5183-4715-b7a0-8ea690fd6b43 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:45.542543 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefec00a-3ed6-4c57-a94d-85c48e953a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:45.543428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefec00a-3ed6-4c57-a94d-85c48e953a5c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:45.543628 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefec00a-3ed6-4c57-a94d-85c48e953a5c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:45.543905 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefec00a-3ed6-4c57-a94d-85c48e953a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:45.566279 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcb552-fa3d-4fde-b261-bc894249419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:45.566886 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefec00a-3ed6-4c57-a94d-85c48e953a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:45.567683 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb552-fa3d-4fde-b261-bc894249419b None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:45.568178 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb552-fa3d-4fde-b261-bc894249419b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:45.568346 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefec00a-3ed6-4c57-a94d-85c48e953a5c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:45.568792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb552-fa3d-4fde-b261-bc894249419b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:45.580163 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcb552-fa3d-4fde-b261-bc894249419b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:45.581936 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcb552-fa3d-4fde-b261-bc894249419b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:45.602177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-aefec00a-3ed6-4c57-a94d-85c48e953a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:45.602177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:45.602177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:45.602177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:45.602177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:45.602177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:45.602177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:45.602177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:45.602177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:45.602177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:45.602177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:45.602177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:45.602177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:45.602177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:45.602177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:45.603087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:45.603087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:45.603087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:45.603087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:45.603087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:45.603087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:45.603087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:45.603087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:45.603087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:45.603087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:45.603087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:45.603087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:45.603087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:45.603087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:45.603087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:45.603087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:45.603087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:45.603932 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:45.603932 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:45.603932 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:45.603932 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:45.605696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-4ffcb552-fa3d-4fde-b261-bc894249419b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:45.605696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:45.605696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:45.605696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:45.605696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:45.605696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:45.605696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:45.605696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:45.605696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:45.605696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:45.605696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:45.605696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:45.605696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:45.605696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:45.605696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:45.606509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:45.606509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:45.606509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:45.606509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:45.606509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:45.606509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:45.606509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:45.606509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:45.606509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:45.606509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:45.606509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:45.606509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:45.606509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:45.606509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:45.606509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:45.606509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:45.606509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:45.607323 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:45.607323 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:45.607323 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:45.607323 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:45.609424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 279/554] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:45.609943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 276/555] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:45.611571 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcb552-fa3d-4fde-b261-bc894249419b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:45.615434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefec00a-3ed6-4c57-a94d-85c48e953a5c None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:45.722725 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcb552-fa3d-4fde-b261-bc894249419b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:45.757761 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4c5a-976d-45d2-880b-aa17dac89a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:45.759202 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4c5a-976d-45d2-880b-aa17dac89a2d None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:45.759702 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4c5a-976d-45d2-880b-aa17dac89a2d None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:45.760165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4c5a-976d-45d2-880b-aa17dac89a2d None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:45.761098 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c4c5a-976d-45d2-880b-aa17dac89a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:45.761603 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c4c5a-976d-45d2-880b-aa17dac89a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:45.763259 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c4c5a-976d-45d2-880b-aa17dac89a2d None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:45.776836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 280/556] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:45.782951 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4c5a-976d-45d2-880b-aa17dac89a2d None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:45.863976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefec00a-3ed6-4c57-a94d-85c48e953a5c None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:45.922017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4c5a-976d-45d2-880b-aa17dac89a2d None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:45.947379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97823dc0-10cc-45c7-80d5-ad075ed21d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:45.948106 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97823dc0-10cc-45c7-80d5-ad075ed21d09 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:45.948388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97823dc0-10cc-45c7-80d5-ad075ed21d09 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:45.948656 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97823dc0-10cc-45c7-80d5-ad075ed21d09 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:45.949379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97823dc0-10cc-45c7-80d5-ad075ed21d09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:45.949682 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97823dc0-10cc-45c7-80d5-ad075ed21d09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:45.951073 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97823dc0-10cc-45c7-80d5-ad075ed21d09 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:45.964643 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9285fe-a587-42bd-aea5-a231318bf974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:45.965836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9285fe-a587-42bd-aea5-a231318bf974 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:45.966308 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9285fe-a587-42bd-aea5-a231318bf974 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:45.966820 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9285fe-a587-42bd-aea5-a231318bf974 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:45.974933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9285fe-a587-42bd-aea5-a231318bf974 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:45.975199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 277/557] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:45.976917 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ccb05-fc3f-40c8-8129-8d43aaf69fda None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:45.977130 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9285fe-a587-42bd-aea5-a231318bf974 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:45.977227 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ccb05-fc3f-40c8-8129-8d43aaf69fda None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:45.977462 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ccb05-fc3f-40c8-8129-8d43aaf69fda None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:45.978710 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 278/558] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:45.984350 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c01f09-df9e-43eb-8b09-468b9fa781a9 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:45.984638 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c01f09-df9e-43eb-8b09-468b9fa781a9 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:45.984981 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c01f09-df9e-43eb-8b09-468b9fa781a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:45.993236 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-4c9285fe-a587-42bd-aea5-a231318bf974 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 09:47:45.993236 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:45.993236 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:45.993236 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:45.993236 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:45.993236 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:45.993236 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:45.993236 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:45.993236 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:45.993236 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:45.993236 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:45.993236 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:45.993236 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:47:45.993236 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:47:45.993236 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:47:45.993236 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:45.994151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:45.995046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:45.995046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:45.995046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:47:45.995046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:47:45.995046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:47:45.995046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:47:45.995046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:47:45.995046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:47:45.995046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 09:47:45.995046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:45.997579 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 281/559] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:47:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:45.998577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9285fe-a587-42bd-aea5-a231318bf974 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:46.006543 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-50c01f09-df9e-43eb-8b09-468b9fa781a9 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:46.008114 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-50c01f09-df9e-43eb-8b09-468b9fa781a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:46.089904 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 279/560] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:47:46.090879 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c01f09-df9e-43eb-8b09-468b9fa781a9 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:46.103169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9285fe-a587-42bd-aea5-a231318bf974 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:46.138862 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125f522-8ef9-46da-bf48-f30a6c85fea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:46.139672 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f522-8ef9-46da-bf48-f30a6c85fea7 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:46.139952 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f522-8ef9-46da-bf48-f30a6c85fea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:46.140226 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f522-8ef9-46da-bf48-f30a6c85fea7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:46.148515 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125f522-8ef9-46da-bf48-f30a6c85fea7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:46.150347 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125f522-8ef9-46da-bf48-f30a6c85fea7 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:46.167660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-b125f522-8ef9-46da-bf48-f30a6c85fea7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:46.167660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:46.167660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:46.167660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:46.167660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:46.167660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:46.167660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:46.167660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:46.167660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:46.167660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:46.167660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:46.167660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:46.167660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:47:46.167660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:47:46.167660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:47:46.168564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:47:46.168564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:46.168564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:46.168564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:46.168564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:46.168564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:46.168564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:46.168564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:46.168564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:46.168564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:46.168564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:46.168564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:46.168564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:46.168564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:46.168564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:46.168564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:46.168564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:46.170519 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:47:46.170519 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:47:46.170519 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:47:46.170519 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:47:46.170519 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:47:46.170519 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:47:46.170519 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:46.170519 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:46.170519 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 282/561] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:46.170519 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125f522-8ef9-46da-bf48-f30a6c85fea7 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:46.228166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c01f09-df9e-43eb-8b09-468b9fa781a9 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:46.263638 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bf981-1338-4206-af09-472fc07dabc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:46.264335 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bf981-1338-4206-af09-472fc07dabc5 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:46.264612 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bf981-1338-4206-af09-472fc07dabc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:46.264888 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bf981-1338-4206-af09-472fc07dabc5 None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:46.265751 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bf981-1338-4206-af09-472fc07dabc5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:46.266098 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bf981-1338-4206-af09-472fc07dabc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:46.267593 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bf981-1338-4206-af09-472fc07dabc5 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:46.277646 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125f522-8ef9-46da-bf48-f30a6c85fea7 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:46.290193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 280/562] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 3 09:47:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:46.291196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bf981-1338-4206-af09-472fc07dabc5 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:46.315629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60ef20-1952-4f17-ab7e-45a6c2452be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:46.316709 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60ef20-1952-4f17-ab7e-45a6c2452be0 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:46.316992 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60ef20-1952-4f17-ab7e-45a6c2452be0 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:46.317269 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60ef20-1952-4f17-ab7e-45a6c2452be0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:46.327276 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60ef20-1952-4f17-ab7e-45a6c2452be0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:46.335150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-2c60ef20-1952-4f17-ab7e-45a6c2452be0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:46.335150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:46.335150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:46.335150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:46.335150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:46.335150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:46.335150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:46.335150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:46.335150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:46.335150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:46.335150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:46.335150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:46.335150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:46.335150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:46.335150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:46.335150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:46.336148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:46.336148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:46.336148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:46.336148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:46.336148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:46.336148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:46.336148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:46.336148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:46.336148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:46.336148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:46.336148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:46.336148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:46.336148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:46.336148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:46.336148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:46.336148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:46.336956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:46.336956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:46.336956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:46.336956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:46.336956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:46.336956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:46.336956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:46.336956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:46.336956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:46.336956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:46.336956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:46.336956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:46.336956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 283/563] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:46.338156 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920b70c-7087-48bd-a86b-8e54189c1ea4 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:46.338335 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920b70c-7087-48bd-a86b-8e54189c1ea4 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:46.338603 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920b70c-7087-48bd-a86b-8e54189c1ea4 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:46.339982 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 284/564] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:46.340571 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920b70c-7087-48bd-a86b-8e54189c1ea4 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:46.397879 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bf981-1338-4206-af09-472fc07dabc5 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:46.430634 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3884a-6c1c-45da-b3fe-9b06dd8e1953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:46.431366 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3884a-6c1c-45da-b3fe-9b06dd8e1953 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:46.431657 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3884a-6c1c-45da-b3fe-9b06dd8e1953 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:46.431929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3884a-6c1c-45da-b3fe-9b06dd8e1953 None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:46.432713 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3884a-6c1c-45da-b3fe-9b06dd8e1953 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:46.433018 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3884a-6c1c-45da-b3fe-9b06dd8e1953 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:46.434546 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3884a-6c1c-45da-b3fe-9b06dd8e1953 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:46.450601 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 281/565] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:47:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:46.450601 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3884a-6c1c-45da-b3fe-9b06dd8e1953 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:46.454133 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920b70c-7087-48bd-a86b-8e54189c1ea4 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:46.485573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904854d2-274f-4b8c-819a-dfd329e4d8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:46.486159 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904854d2-274f-4b8c-819a-dfd329e4d8fc None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:46.486434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904854d2-274f-4b8c-819a-dfd329e4d8fc None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:46.486701 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904854d2-274f-4b8c-819a-dfd329e4d8fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:46.542581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3884a-6c1c-45da-b3fe-9b06dd8e1953 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:46.550649 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904854d2-274f-4b8c-819a-dfd329e4d8fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:46.552086 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904854d2-274f-4b8c-819a-dfd329e4d8fc None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:46.574989 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8e819-c72a-4403-81dc-15f1828138a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:46.575663 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8e819-c72a-4403-81dc-15f1828138a2 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:46.575939 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8e819-c72a-4403-81dc-15f1828138a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:46.576209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8e819-c72a-4403-81dc-15f1828138a2 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:46.576948 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8e819-c72a-4403-81dc-15f1828138a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:46.577250 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8e819-c72a-4403-81dc-15f1828138a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:46.578640 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8e819-c72a-4403-81dc-15f1828138a2 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:46.586342 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 282/566] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:47:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:46.587508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9074e9a-9792-4786-bb9b-50515104be19 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:46.588136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9074e9a-9792-4786-bb9b-50515104be19 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:46.588136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9074e9a-9792-4786-bb9b-50515104be19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:46.604070 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-a9074e9a-9792-4786-bb9b-50515104be19 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:46.605233 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-a9074e9a-9792-4786-bb9b-50515104be19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:46.645616 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 285/567] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:46.646470 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904854d2-274f-4b8c-819a-dfd329e4d8fc None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:46.668057 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 283/568] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:46.669428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37158aa-ace8-41e4-bcf3-13a4cdced3c2 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:46.669705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37158aa-ace8-41e4-bcf3-13a4cdced3c2 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:46.670016 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37158aa-ace8-41e4-bcf3-13a4cdced3c2 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:46.671407 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 284/569] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:46.671956 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37158aa-ace8-41e4-bcf3-13a4cdced3c2 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:46.744994 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904854d2-274f-4b8c-819a-dfd329e4d8fc None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:46.771691 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37158aa-ace8-41e4-bcf3-13a4cdced3c2 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:46.777524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18686229-851c-434b-837b-31e0ff0e7e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:46.778445 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18686229-851c-434b-837b-31e0ff0e7e4d None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:46.778723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18686229-851c-434b-837b-31e0ff0e7e4d None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:46.778990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18686229-851c-434b-837b-31e0ff0e7e4d None admin] PATH_INFO: `/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/efb008cfc6424998917da60d72689f55/roles/779b01e1e2534bfba9971e7000b7c628` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:46.792868 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18686229-851c-434b-837b-31e0ff0e7e4d None admin] RBAC: Authorizing `identity:create_grant(project_id=f395f4842c39422d962dbddc4cf2897a, user_id=efb008cfc6424998917da60d72689f55, role_id=779b01e1e2534bfba9971e7000b7c628)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:46.794336 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18686229-851c-434b-837b-31e0ff0e7e4d None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:46.805660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2e017-9deb-45ff-9e93-a4717f775109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:46.806520 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2e017-9deb-45ff-9e93-a4717f775109 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:46.806786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2e017-9deb-45ff-9e93-a4717f775109 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:46.807055 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2e017-9deb-45ff-9e93-a4717f775109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:46.808893 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 286/570] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:47:46 2022] PUT /identity/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/efb008cfc6424998917da60d72689f55/roles/779b01e1e2534bfba9971e7000b7c628 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:47:46.809702 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18686229-851c-434b-837b-31e0ff0e7e4d None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:46.817334 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2e017-9deb-45ff-9e93-a4717f775109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:46.818853 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2e017-9deb-45ff-9e93-a4717f775109 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:46.838182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-96f2e017-9deb-45ff-9e93-a4717f775109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:46.838182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:46.838182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:46.838182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:46.838182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:46.838182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:46.838182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:46.838182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:46.838182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:46.838182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:46.838182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:46.838182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:46.838182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:46.838182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:46.838182 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:46.839183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:46.839183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:46.839183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:46.839183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:46.839183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:46.839183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:46.839183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:46.839183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:46.839183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:46.839183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:46.839183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:46.839183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:46.839183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:46.839183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:46.839183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:46.839183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:46.839183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:46.845284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:46.845284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:46.845284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:46.845284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:46.845284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 285/571] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:46.845284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d21c2a-d931-4b7e-8ad8-bbe1daede72b None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:46.845284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d21c2a-d931-4b7e-8ad8-bbe1daede72b None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:46.845284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d21c2a-d931-4b7e-8ad8-bbe1daede72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:46.863410 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-51d21c2a-d931-4b7e-8ad8-bbe1daede72b None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:46.864616 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-51d21c2a-d931-4b7e-8ad8-bbe1daede72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:46.922148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18686229-851c-434b-837b-31e0ff0e7e4d None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:46.935382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 286/572] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:46.936606 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d21c2a-d931-4b7e-8ad8-bbe1daede72b None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:46.984071 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5309be3-1772-4fd3-abcc-1ce6289bd74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:46.984878 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5309be3-1772-4fd3-abcc-1ce6289bd74f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:46.985154 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5309be3-1772-4fd3-abcc-1ce6289bd74f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:46.985423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5309be3-1772-4fd3-abcc-1ce6289bd74f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:46.999935 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5309be3-1772-4fd3-abcc-1ce6289bd74f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:47.001523 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5309be3-1772-4fd3-abcc-1ce6289bd74f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:47.020446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-a5309be3-1772-4fd3-abcc-1ce6289bd74f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:47.020446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:47.020446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:47.020446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:47.020446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:47.020446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:47.020446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:47.020446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:47.020446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:47.020446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:47.020446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:47.020446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:47.020446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:47.020446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:47.020446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:47.021877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:47.021877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:47.021877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:47.021877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:47.021877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:47.021877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:47.021877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:47.021877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:47.021877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:47.021877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:47.021877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:47.021877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:47.021877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:47.021877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:47.021877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:47.021877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:47.021877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:47.022858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:47.022858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:47.022858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:47.022858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:47.022858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 287/573] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:47.023622 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5309be3-1772-4fd3-abcc-1ce6289bd74f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:47.047641 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d21c2a-d931-4b7e-8ad8-bbe1daede72b None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:47.080898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe6aa2-68b0-4aa4-a8d9-2fe5911ed9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:47.082021 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe6aa2-68b0-4aa4-a8d9-2fe5911ed9f6 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:47.082303 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe6aa2-68b0-4aa4-a8d9-2fe5911ed9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:47.082582 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe6aa2-68b0-4aa4-a8d9-2fe5911ed9f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:47.092481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe6aa2-68b0-4aa4-a8d9-2fe5911ed9f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:47.100168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-2dfe6aa2-68b0-4aa4-a8d9-2fe5911ed9f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:47.100168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:47.100168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:47.100168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:47.100168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:47.100168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:47.100168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:47.100168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:47.100168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:47.100168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:47.100168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:47.100168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:47.100168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:47.100168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:47.100168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:47.100168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:47.101283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:47.101283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:47.101283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:47.101283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:47.101283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:47.101283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:47.101283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:47.101283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:47.101283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:47.101283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:47.101283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:47.101283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:47.101283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:47.101283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:47.101283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:47.101283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:47.107615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:47.107615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:47.107615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:47.107615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:47.107615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:47.107615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:47.107615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:47.107615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:47.107615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:47.107615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:47.107615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:47.107615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:47.107615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 287/574] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:47.107615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe6aa2-68b0-4aa4-a8d9-2fe5911ed9f6 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:47.123907 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5309be3-1772-4fd3-abcc-1ce6289bd74f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:47.158027 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee295092-e15e-4998-9338-0a2f32792ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:47.158686 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee295092-e15e-4998-9338-0a2f32792ec7 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:47.158964 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee295092-e15e-4998-9338-0a2f32792ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:47.159240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee295092-e15e-4998-9338-0a2f32792ec7 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:47.159960 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee295092-e15e-4998-9338-0a2f32792ec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:47.160261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee295092-e15e-4998-9338-0a2f32792ec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:47.161643 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee295092-e15e-4998-9338-0a2f32792ec7 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:47.177256 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 288/575] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:47.178040 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee295092-e15e-4998-9338-0a2f32792ec7 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:47.207801 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe6aa2-68b0-4aa4-a8d9-2fe5911ed9f6 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:47.240165 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c9985-7976-41ea-8a1d-3129078d0082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:47.240982 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c9985-7976-41ea-8a1d-3129078d0082 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:47.241259 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c9985-7976-41ea-8a1d-3129078d0082 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:47.241514 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c9985-7976-41ea-8a1d-3129078d0082 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:47.252592 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c9985-7976-41ea-8a1d-3129078d0082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:47.260581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-ac3c9985-7976-41ea-8a1d-3129078d0082 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:47.260581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:47.260581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:47.260581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:47.260581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:47.260581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:47.260581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:47.260581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:47.260581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:47.260581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:47.260581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:47.260581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:47.260581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:47.260581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:47.260581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:47.260581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:47.261722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:47.261722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:47.261722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:47.261722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:47.261722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:47.261722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:47.261722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:47.261722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:47.261722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:47.261722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:47.261722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:47.261722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:47.261722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:47.261722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:47.261722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:47.261722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:47.262804 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:47.262804 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:47.262804 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:47.262804 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:47.262804 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:47.262804 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:47.262804 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:47.262804 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:47.262804 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:47.262804 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:47.262804 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:47.262804 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:47.266641 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 288/576] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:47.267372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c9985-7976-41ea-8a1d-3129078d0082 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:47.281156 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee295092-e15e-4998-9338-0a2f32792ec7 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:47.315520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034a3b1-ac63-4cb9-8c99-0b7ef17156e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:47.316189 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034a3b1-ac63-4cb9-8c99-0b7ef17156e1 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:47.316473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034a3b1-ac63-4cb9-8c99-0b7ef17156e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:47.316747 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034a3b1-ac63-4cb9-8c99-0b7ef17156e1 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:47.317461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034a3b1-ac63-4cb9-8c99-0b7ef17156e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:47.317767 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034a3b1-ac63-4cb9-8c99-0b7ef17156e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:47.319158 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034a3b1-ac63-4cb9-8c99-0b7ef17156e1 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:47.330767 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 289/577] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:47.332506 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034a3b1-ac63-4cb9-8c99-0b7ef17156e1 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:47.362065 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c9985-7976-41ea-8a1d-3129078d0082 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:47.393893 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15881a6f-db52-4d5c-b9e5-2ebec9513886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:47.394558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15881a6f-db52-4d5c-b9e5-2ebec9513886 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:47.394840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15881a6f-db52-4d5c-b9e5-2ebec9513886 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:47.395115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15881a6f-db52-4d5c-b9e5-2ebec9513886 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:47.395850 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15881a6f-db52-4d5c-b9e5-2ebec9513886 None admin] RBAC: Adding query filter params (name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:47.396151 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15881a6f-db52-4d5c-b9e5-2ebec9513886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:47.397509 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15881a6f-db52-4d5c-b9e5-2ebec9513886 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:47.405589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 289/578] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:47:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:47.406234 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15881a6f-db52-4d5c-b9e5-2ebec9513886 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:47.427319 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034a3b1-ac63-4cb9-8c99-0b7ef17156e1 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:47.459772 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b58a41-a1c1-456a-9313-167f31c55476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:47.460590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b58a41-a1c1-456a-9313-167f31c55476 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:47.460869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b58a41-a1c1-456a-9313-167f31c55476 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:47.461136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b58a41-a1c1-456a-9313-167f31c55476 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:47.468278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b58a41-a1c1-456a-9313-167f31c55476 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:47.469732 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b58a41-a1c1-456a-9313-167f31c55476 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:47.491913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-a0b58a41-a1c1-456a-9313-167f31c55476 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 09:47:47.491913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:47.491913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:47.491913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:47.491913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:47.491913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:47.491913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:47.491913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:47.491913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:47.491913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:47.491913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:47.491913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:47.491913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:47:47.491913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:47:47.491913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:47:47.491913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:47.493290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:47.494706 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:47.494706 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:47.494706 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:47:47.494706 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:47:47.494706 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:47:47.494706 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:47:47.494706 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:47:47.494706 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:47:47.494706 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 09:47:47.494706 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:47.497945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 290/579] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:47.499037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b58a41-a1c1-456a-9313-167f31c55476 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:47.503423 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15881a6f-db52-4d5c-b9e5-2ebec9513886 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:47.536387 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda0efd-3efa-4178-b42d-1e453cc4de25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:47.537222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda0efd-3efa-4178-b42d-1e453cc4de25 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:47.537504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda0efd-3efa-4178-b42d-1e453cc4de25 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:47.537776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda0efd-3efa-4178-b42d-1e453cc4de25 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:47.538554 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda0efd-3efa-4178-b42d-1e453cc4de25 None admin] RBAC: Adding query filter params (name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:47.538897 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda0efd-3efa-4178-b42d-1e453cc4de25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:47.540253 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda0efd-3efa-4178-b42d-1e453cc4de25 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:47.548499 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 290/580] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:47:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:47.549281 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda0efd-3efa-4178-b42d-1e453cc4de25 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:47.595323 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b58a41-a1c1-456a-9313-167f31c55476 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:47.628970 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a5342-2bca-4355-ad30-288b692fb0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:47.630119 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a5342-2bca-4355-ad30-288b692fb0b8 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:47.630391 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a5342-2bca-4355-ad30-288b692fb0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:47.630660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a5342-2bca-4355-ad30-288b692fb0b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:47.637907 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a5342-2bca-4355-ad30-288b692fb0b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:47.639353 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a5342-2bca-4355-ad30-288b692fb0b8 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:47.648294 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda0efd-3efa-4178-b42d-1e453cc4de25 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:47.653169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-7a0a5342-2bca-4355-ad30-288b692fb0b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:47.653169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:47.653169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:47.653169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:47.653169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:47.653169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:47.653169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:47.653169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:47.653169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:47.653169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:47.653169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:47.653169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:47.653169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:47:47.653169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:47:47.653169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:47:47.654117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:47:47.654117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:47.654117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:47.654117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:47.654117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:47.654117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:47.654117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:47.654117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:47.654117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:47.654117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:47.654117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:47.654117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:47.654117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:47.654117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:47.654117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:47.654117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:47.654117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:47.659967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:47:47.659967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:47:47.659967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:47:47.659967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:47:47.659967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:47:47.659967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:47:47.659967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:47.659967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:47.659967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 291/581] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:47.659967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a5342-2bca-4355-ad30-288b692fb0b8 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:47.689087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f666c-bb03-4409-ae7f-5a2e469f98ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:47.689958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f666c-bb03-4409-ae7f-5a2e469f98ca None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:47.690400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f666c-bb03-4409-ae7f-5a2e469f98ca None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:47.690674 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f666c-bb03-4409-ae7f-5a2e469f98ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:47.702745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f666c-bb03-4409-ae7f-5a2e469f98ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:47.704187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f666c-bb03-4409-ae7f-5a2e469f98ca None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:47.721110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-cd3f666c-bb03-4409-ae7f-5a2e469f98ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:47.721110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:47.721110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:47.721110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:47.721110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:47.721110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:47.721110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:47.721110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:47.721110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:47.721110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:47.721110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:47.721110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:47.721110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:47.721110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:47.721110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:47.722031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:47.722031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:47.722031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:47.722031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:47.722031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:47.722031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:47.722031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:47.722031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:47.722031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:47.722031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:47.722031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:47.722031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:47.722031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:47.722031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:47.722031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:47.722031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:47.722031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:47.722906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:47.722906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:47.722906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:47.722906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:47.722906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 291/582] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:47.723183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f666c-bb03-4409-ae7f-5a2e469f98ca None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:47.759943 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a5342-2bca-4355-ad30-288b692fb0b8 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:47.797363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c54c4f-b28b-4a88-b966-fd1a6e0de87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:47.798852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c54c4f-b28b-4a88-b966-fd1a6e0de87f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:47.799137 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c54c4f-b28b-4a88-b966-fd1a6e0de87f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:47.799406 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c54c4f-b28b-4a88-b966-fd1a6e0de87f None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:47.800246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c54c4f-b28b-4a88-b966-fd1a6e0de87f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:47.800552 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c54c4f-b28b-4a88-b966-fd1a6e0de87f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:47.801995 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c54c4f-b28b-4a88-b966-fd1a6e0de87f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:47.825965 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 292/583] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 3 09:47:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:47.826854 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c54c4f-b28b-4a88-b966-fd1a6e0de87f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:47.830912 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f666c-bb03-4409-ae7f-5a2e469f98ca None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:47.865753 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d481401-842c-4306-bc1c-d2c1f17fa79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:47.866818 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481401-842c-4306-bc1c-d2c1f17fa79e None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:47.867290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481401-842c-4306-bc1c-d2c1f17fa79e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:47.867675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481401-842c-4306-bc1c-d2c1f17fa79e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:47.878096 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d481401-842c-4306-bc1c-d2c1f17fa79e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:47.879614 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d481401-842c-4306-bc1c-d2c1f17fa79e None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:47.897077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-7d481401-842c-4306-bc1c-d2c1f17fa79e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:47.897077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:47.897077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:47.897077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:47.897077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:47.897077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:47.897077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:47.897077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:47.897077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:47.897077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:47.897077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:47.897077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:47.897077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:47.897077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:47.897077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:47.898332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:47.898332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:47.898332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:47.898332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:47.898332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:47.898332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:47.898332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:47.898332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:47.898332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:47.898332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:47.898332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:47.898332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:47.898332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:47.898332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:47.898332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:47.898332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:47.898332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:47.904415 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:47.904415 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:47.904415 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:47.904415 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:47.904415 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 292/584] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:47.904415 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d481401-842c-4306-bc1c-d2c1f17fa79e None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:47.935215 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c54c4f-b28b-4a88-b966-fd1a6e0de87f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:47.968857 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0507d-fd87-4b6a-937e-6ca7d446262c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:47.969617 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0507d-fd87-4b6a-937e-6ca7d446262c None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:47.969922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0507d-fd87-4b6a-937e-6ca7d446262c None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:47.970192 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0507d-fd87-4b6a-937e-6ca7d446262c None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:47.970989 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0507d-fd87-4b6a-937e-6ca7d446262c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:47.971294 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0507d-fd87-4b6a-937e-6ca7d446262c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:47.972732 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0507d-fd87-4b6a-937e-6ca7d446262c None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:47.984664 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 293/585] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:47:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:47.986772 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0507d-fd87-4b6a-937e-6ca7d446262c None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:48.000065 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d481401-842c-4306-bc1c-d2c1f17fa79e None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:48.037612 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45545d-f21c-455c-9c0b-a40339aa92f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:48.038309 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45545d-f21c-455c-9c0b-a40339aa92f1 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:48.038587 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45545d-f21c-455c-9c0b-a40339aa92f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:48.039504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45545d-f21c-455c-9c0b-a40339aa92f1 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:48.040223 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45545d-f21c-455c-9c0b-a40339aa92f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:48.040838 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45545d-f21c-455c-9c0b-a40339aa92f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:48.042377 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45545d-f21c-455c-9c0b-a40339aa92f1 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:48.054722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 293/586] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:48.055557 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45545d-f21c-455c-9c0b-a40339aa92f1 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:48.089208 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0507d-fd87-4b6a-937e-6ca7d446262c None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:48.120487 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49f639-92b6-4333-87eb-19509711931f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:48.121273 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49f639-92b6-4333-87eb-19509711931f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:48.121548 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49f639-92b6-4333-87eb-19509711931f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:48.121892 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49f639-92b6-4333-87eb-19509711931f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:48.131781 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49f639-92b6-4333-87eb-19509711931f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:48.133614 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49f639-92b6-4333-87eb-19509711931f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:48.149818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-ec49f639-92b6-4333-87eb-19509711931f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:48.149818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:48.149818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:48.149818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:48.149818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:48.149818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:48.149818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:48.149818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:48.149818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:48.149818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:48.149818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:48.149818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:48.149818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:48.149818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:48.149818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:48.150735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:48.150735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:48.150735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:48.150735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:48.150735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:48.150735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:48.150735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:48.150735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:48.150735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:48.150735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:48.150735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:48.150735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:48.150735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:48.150735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:48.150735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:48.150735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:48.150735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:48.156516 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:48.156516 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:48.156516 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:48.156516 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:48.156796 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45545d-f21c-455c-9c0b-a40339aa92f1 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:48.156885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 294/587] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:48.156885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49f639-92b6-4333-87eb-19509711931f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:48.188000 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1ae64-0aad-49a2-a63e-07600def18c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:48.188731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1ae64-0aad-49a2-a63e-07600def18c7 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:48.189083 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1ae64-0aad-49a2-a63e-07600def18c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:48.189454 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1ae64-0aad-49a2-a63e-07600def18c7 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:48.190287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1ae64-0aad-49a2-a63e-07600def18c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:48.190683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1ae64-0aad-49a2-a63e-07600def18c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:48.192141 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1ae64-0aad-49a2-a63e-07600def18c7 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:48.203237 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 294/588] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:48.204127 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1ae64-0aad-49a2-a63e-07600def18c7 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:48.250754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49f639-92b6-4333-87eb-19509711931f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:48.283828 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d13e74-6742-4e82-803b-a0ae40aa0df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:48.284743 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d13e74-6742-4e82-803b-a0ae40aa0df4 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:48.285160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d13e74-6742-4e82-803b-a0ae40aa0df4 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:48.285607 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d13e74-6742-4e82-803b-a0ae40aa0df4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:48.286626 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d13e74-6742-4e82-803b-a0ae40aa0df4 None admin] RBAC: Adding query filter params (role.id=779b01e1e2534bfba9971e7000b7c628, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=73dfc1b485d647f1ae59a405c978599f) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:48.287129 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d13e74-6742-4e82-803b-a0ae40aa0df4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:48.288929 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d13e74-6742-4e82-803b-a0ae40aa0df4 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:48.294554 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 295/589] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:47:48 2022] GET /identity/v3/role_assignments?user.id=73dfc1b485d647f1ae59a405c978599f&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=779b01e1e2534bfba9971e7000b7c628 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:48.296762 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1ae64-0aad-49a2-a63e-07600def18c7 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:48.299442 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d13e74-6742-4e82-803b-a0ae40aa0df4 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:48.333500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501bb5b-c0a6-4f4a-870f-d0301be70a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:48.334671 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501bb5b-c0a6-4f4a-870f-d0301be70a77 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:48.334671 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501bb5b-c0a6-4f4a-870f-d0301be70a77 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:48.334947 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501bb5b-c0a6-4f4a-870f-d0301be70a77 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:48.344297 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501bb5b-c0a6-4f4a-870f-d0301be70a77 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:48.345760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501bb5b-c0a6-4f4a-870f-d0301be70a77 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:48.362009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-0501bb5b-c0a6-4f4a-870f-d0301be70a77 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 09:47:48.362009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:48.362009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:48.362009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:48.362009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:48.362009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:48.362009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:48.362009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:48.362009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:48.362009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:48.362009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:48.362009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:48.362009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:47:48.362009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:47:48.362009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:47:48.362009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:48.363522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:48.364993 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:48.364993 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:48.364993 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:47:48.364993 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:47:48.364993 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:47:48.364993 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:47:48.364993 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:47:48.364993 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:47:48.364993 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 09:47:48.364993 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:48.364993 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 295/590] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:48.364993 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501bb5b-c0a6-4f4a-870f-d0301be70a77 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:48.436743 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d13e74-6742-4e82-803b-a0ae40aa0df4 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:48.474140 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f61284-761e-46aa-98bb-a4414ba48078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:48.475186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f61284-761e-46aa-98bb-a4414ba48078 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:48.475684 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f61284-761e-46aa-98bb-a4414ba48078 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:48.476215 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f61284-761e-46aa-98bb-a4414ba48078 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:48.477141 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f61284-761e-46aa-98bb-a4414ba48078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:48.477424 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501bb5b-c0a6-4f4a-870f-d0301be70a77 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:48.477894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f61284-761e-46aa-98bb-a4414ba48078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:48.479488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f61284-761e-46aa-98bb-a4414ba48078 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:48.492151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 296/591] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:48.497915 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f61284-761e-46aa-98bb-a4414ba48078 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:48.513617 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea31e8e-e16a-4cc4-a5df-b77d43a6961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:48.514523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea31e8e-e16a-4cc4-a5df-b77d43a6961e None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:48.514742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea31e8e-e16a-4cc4-a5df-b77d43a6961e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:48.515014 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea31e8e-e16a-4cc4-a5df-b77d43a6961e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:48.522895 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea31e8e-e16a-4cc4-a5df-b77d43a6961e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:48.525245 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea31e8e-e16a-4cc4-a5df-b77d43a6961e None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:48.540673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-9ea31e8e-e16a-4cc4-a5df-b77d43a6961e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 09:47:48.540673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:48.540673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:48.540673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:48.540673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:48.540673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:48.540673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:48.540673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:48.540673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:48.540673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:48.540673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:48.540673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:48.540673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:47:48.540673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:47:48.540673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:47:48.540673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:48.541645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:48.542632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:48.542632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:48.542632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:47:48.542632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:47:48.542632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:47:48.542632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:47:48.542632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:47:48.542632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:47:48.542632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 09:47:48.542632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:48.546897 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 296/592] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:48.547739 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea31e8e-e16a-4cc4-a5df-b77d43a6961e None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:48.602107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f61284-761e-46aa-98bb-a4414ba48078 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:48.636362 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2cc03-b295-470e-b9bf-e7f890b599dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:48.637641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2cc03-b295-470e-b9bf-e7f890b599dd None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:48.638389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2cc03-b295-470e-b9bf-e7f890b599dd None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:48.639049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2cc03-b295-470e-b9bf-e7f890b599dd None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:48.640604 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2cc03-b295-470e-b9bf-e7f890b599dd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:48.641323 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2cc03-b295-470e-b9bf-e7f890b599dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:48.643836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2cc03-b295-470e-b9bf-e7f890b599dd None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:48.651313 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea31e8e-e16a-4cc4-a5df-b77d43a6961e None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:48.672566 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 297/593] 10.222.0.55 () {56 vars in 1139 bytes} [Tue May 3 09:47:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:48.673976 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2cc03-b295-470e-b9bf-e7f890b599dd None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:48.691947 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a52998-6fa1-4d05-96f4-013e00cd909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:48.692751 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a52998-6fa1-4d05-96f4-013e00cd909b None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:48.693030 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a52998-6fa1-4d05-96f4-013e00cd909b None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:48.693297 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a52998-6fa1-4d05-96f4-013e00cd909b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:48.701040 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a52998-6fa1-4d05-96f4-013e00cd909b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:48.702571 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a52998-6fa1-4d05-96f4-013e00cd909b None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:48.718500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-12a52998-6fa1-4d05-96f4-013e00cd909b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:48.718500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:48.718500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:48.718500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:48.718500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:48.718500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:48.718500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:48.718500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:48.718500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:48.718500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:48.718500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:48.718500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:48.718500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:47:48.718500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:47:48.718500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:47:48.719516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:47:48.719516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:48.719516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:48.719516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:48.719516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:48.719516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:48.719516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:48.719516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:48.719516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:48.719516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:48.719516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:48.719516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:48.719516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:48.719516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:48.719516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:48.719516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:48.719516 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:48.720403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:47:48.720403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:47:48.720403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:47:48.720403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:47:48.720403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:47:48.720403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:47:48.720403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:48.720403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:48.724478 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 297/594] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:48.725325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a52998-6fa1-4d05-96f4-013e00cd909b None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:48.780179 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2cc03-b295-470e-b9bf-e7f890b599dd None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:48.813127 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9919265-8653-4954-85c2-7f5e6d61b009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:48.814188 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9919265-8653-4954-85c2-7f5e6d61b009 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:48.814679 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9919265-8653-4954-85c2-7f5e6d61b009 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:48.815166 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9919265-8653-4954-85c2-7f5e6d61b009 None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:48.816190 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9919265-8653-4954-85c2-7f5e6d61b009 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:48.816702 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9919265-8653-4954-85c2-7f5e6d61b009 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:48.818350 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9919265-8653-4954-85c2-7f5e6d61b009 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:48.828648 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a52998-6fa1-4d05-96f4-013e00cd909b None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:48.836390 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 298/595] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 3 09:47:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:48.837505 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9919265-8653-4954-85c2-7f5e6d61b009 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:48.868857 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa2b06-e611-4abc-8ca3-50e8a5bcd4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:48.869704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa2b06-e611-4abc-8ca3-50e8a5bcd4bb None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:48.870018 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa2b06-e611-4abc-8ca3-50e8a5bcd4bb None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:48.870290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa2b06-e611-4abc-8ca3-50e8a5bcd4bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:48.880653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa2b06-e611-4abc-8ca3-50e8a5bcd4bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:48.881981 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa2b06-e611-4abc-8ca3-50e8a5bcd4bb None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:48.901189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-8cfa2b06-e611-4abc-8ca3-50e8a5bcd4bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:48.901189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:48.901189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:48.901189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:48.901189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:48.901189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:48.901189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:48.901189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:48.901189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:48.901189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:48.901189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:48.901189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:48.901189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:48.901189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:48.901189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:48.902179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:48.902179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:48.902179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:48.902179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:48.902179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:48.902179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:48.902179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:48.902179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:48.902179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:48.902179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:48.902179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:48.902179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:48.902179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:48.902179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:48.902179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:48.902179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:48.902179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:48.903053 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:48.903053 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:48.903053 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:48.903053 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:48.903053 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 298/596] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:48.903749 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa2b06-e611-4abc-8ca3-50e8a5bcd4bb None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:48.940977 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9919265-8653-4954-85c2-7f5e6d61b009 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:48.975971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56927b-caa3-462b-949a-3b6dbb9078b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:48.977079 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56927b-caa3-462b-949a-3b6dbb9078b0 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:48.977659 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56927b-caa3-462b-949a-3b6dbb9078b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:48.978166 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56927b-caa3-462b-949a-3b6dbb9078b0 None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:48.979142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56927b-caa3-462b-949a-3b6dbb9078b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:48.979643 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56927b-caa3-462b-949a-3b6dbb9078b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:48.981275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56927b-caa3-462b-949a-3b6dbb9078b0 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:48.993887 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 299/597] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:47:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:48.995022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56927b-caa3-462b-949a-3b6dbb9078b0 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:49.016011 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa2b06-e611-4abc-8ca3-50e8a5bcd4bb None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:49.050733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb709d-72a1-4598-ab93-9a74539fb9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:49.051495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb709d-72a1-4598-ab93-9a74539fb9f6 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:49.051774 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb709d-72a1-4598-ab93-9a74539fb9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:49.052045 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb709d-72a1-4598-ab93-9a74539fb9f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:49.063281 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb709d-72a1-4598-ab93-9a74539fb9f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:49.064676 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb709d-72a1-4598-ab93-9a74539fb9f6 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:49.083835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-edcb709d-72a1-4598-ab93-9a74539fb9f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:49.083835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:49.083835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:49.083835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:49.083835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:49.083835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:49.083835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:49.083835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:49.083835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:49.083835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:49.083835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:49.083835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:49.083835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:49.083835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:49.083835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:49.084779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:49.084779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:49.084779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:49.084779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:49.084779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:49.084779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:49.084779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:49.084779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:49.084779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:49.084779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:49.084779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:49.084779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:49.084779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:49.084779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:49.084779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:49.084779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:49.084779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:49.085769 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:49.085769 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:49.085769 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:49.085769 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:49.090317 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 299/598] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:49.090927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb709d-72a1-4598-ab93-9a74539fb9f6 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:49.100910 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56927b-caa3-462b-949a-3b6dbb9078b0 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:49.137883 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa67198-db4d-4a5b-85c6-4c1d312f7172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:49.138546 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67198-db4d-4a5b-85c6-4c1d312f7172 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:49.138828 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67198-db4d-4a5b-85c6-4c1d312f7172 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:49.139112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67198-db4d-4a5b-85c6-4c1d312f7172 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:49.139819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa67198-db4d-4a5b-85c6-4c1d312f7172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:49.140126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa67198-db4d-4a5b-85c6-4c1d312f7172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:49.141509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa67198-db4d-4a5b-85c6-4c1d312f7172 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:49.155266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 300/599] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:49.156148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa67198-db4d-4a5b-85c6-4c1d312f7172 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:49.191679 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb709d-72a1-4598-ab93-9a74539fb9f6 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:49.224638 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a34a64-1457-457d-84d0-a0e164ca3e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:49.225526 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a34a64-1457-457d-84d0-a0e164ca3e02 None admin] REQUEST_METHOD: `PUT` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:49.225821 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a34a64-1457-457d-84d0-a0e164ca3e02 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:49.226154 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a34a64-1457-457d-84d0-a0e164ca3e02 None admin] PATH_INFO: `/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/d5b508ac957b4224912fbc2c2f1ea324/roles/779b01e1e2534bfba9971e7000b7c628` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:49.240348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a34a64-1457-457d-84d0-a0e164ca3e02 None admin] RBAC: Authorizing `identity:create_grant(project_id=f395f4842c39422d962dbddc4cf2897a, user_id=d5b508ac957b4224912fbc2c2f1ea324, role_id=779b01e1e2534bfba9971e7000b7c628)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:49.242149 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a34a64-1457-457d-84d0-a0e164ca3e02 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:49.253724 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa67198-db4d-4a5b-85c6-4c1d312f7172 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:49.257056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 300/600] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:47:49 2022] PUT /identity/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/d5b508ac957b4224912fbc2c2f1ea324/roles/779b01e1e2534bfba9971e7000b7c628 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:47:49.257783 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a07b52-3200-404e-98ab-44c975f15757 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:49.258459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a07b52-3200-404e-98ab-44c975f15757 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:49.258791 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a07b52-3200-404e-98ab-44c975f15757 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:49.260467 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 301/601] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:49.261361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a07b52-3200-404e-98ab-44c975f15757 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:49.321271 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d49a7b-1479-4c55-907b-03180e8ecfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:49.321897 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d49a7b-1479-4c55-907b-03180e8ecfda None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:49.322184 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d49a7b-1479-4c55-907b-03180e8ecfda None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:49.322460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d49a7b-1479-4c55-907b-03180e8ecfda None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:49.323274 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d49a7b-1479-4c55-907b-03180e8ecfda None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:49.323662 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d49a7b-1479-4c55-907b-03180e8ecfda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:49.325183 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d49a7b-1479-4c55-907b-03180e8ecfda None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:49.344014 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 301/602] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:49.345635 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf805a-b5d1-4014-b597-38fa44f12e1e None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:49.346009 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf805a-b5d1-4014-b597-38fa44f12e1e None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:49.346294 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf805a-b5d1-4014-b597-38fa44f12e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:49.364683 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-31bf805a-b5d1-4014-b597-38fa44f12e1e None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:49.366313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-31bf805a-b5d1-4014-b597-38fa44f12e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:49.397324 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a07b52-3200-404e-98ab-44c975f15757 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:49.435785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e531e4-b8af-436d-9da9-fd2e1ca97580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:49.437029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e531e4-b8af-436d-9da9-fd2e1ca97580 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:49.437564 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e531e4-b8af-436d-9da9-fd2e1ca97580 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:49.438053 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e531e4-b8af-436d-9da9-fd2e1ca97580 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:49.443265 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 302/603] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:49.444210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf805a-b5d1-4014-b597-38fa44f12e1e None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:49.446745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e531e4-b8af-436d-9da9-fd2e1ca97580 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:49.448428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e531e4-b8af-436d-9da9-fd2e1ca97580 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:49.462664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-56e531e4-b8af-436d-9da9-fd2e1ca97580 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:49.462664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:49.462664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:49.462664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:49.462664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:49.462664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:49.462664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:49.462664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:49.462664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:49.462664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:49.462664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:49.462664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:49.462664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:47:49.462664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:47:49.462664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:47:49.463596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:47:49.463596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:49.463596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:49.463596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:49.463596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:49.463596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:49.463596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:49.463596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:49.463596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:49.463596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:49.463596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:49.463596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:49.463596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:49.463596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:49.463596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:49.463596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:49.463596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:49.464465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:47:49.464465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:47:49.464465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:47:49.464465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:47:49.464465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:47:49.464465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:47:49.464465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:49.464465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:49.467059 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 302/604] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:49.472115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e531e4-b8af-436d-9da9-fd2e1ca97580 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:49.547491 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf805a-b5d1-4014-b597-38fa44f12e1e None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:49.573743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e531e4-b8af-436d-9da9-fd2e1ca97580 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:49.589785 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe206f6e-0a79-4beb-a9a4-9cdc3204ecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:49.590600 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe206f6e-0a79-4beb-a9a4-9cdc3204ecb4 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:49.590874 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe206f6e-0a79-4beb-a9a4-9cdc3204ecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:49.591138 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe206f6e-0a79-4beb-a9a4-9cdc3204ecb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:49.604447 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe206f6e-0a79-4beb-a9a4-9cdc3204ecb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:49.607235 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe206f6e-0a79-4beb-a9a4-9cdc3204ecb4 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:49.612666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbfa9b-3e8c-4a1d-9cbd-ea785ddea901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:49.613424 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbfa9b-3e8c-4a1d-9cbd-ea785ddea901 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:49.613878 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbfa9b-3e8c-4a1d-9cbd-ea785ddea901 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:49.614241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbfa9b-3e8c-4a1d-9cbd-ea785ddea901 None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:49.615119 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbfa9b-3e8c-4a1d-9cbd-ea785ddea901 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:49.615500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbfa9b-3e8c-4a1d-9cbd-ea785ddea901 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:49.617041 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbfa9b-3e8c-4a1d-9cbd-ea785ddea901 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:49.625151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-fe206f6e-0a79-4beb-a9a4-9cdc3204ecb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:49.625151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:49.625151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:49.625151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:49.625151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:49.625151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:49.625151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:49.625151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:49.625151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:49.625151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:49.625151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:49.625151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:49.625151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:47:49.625151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:47:49.625151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:47:49.626266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:47:49.626266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:49.626266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:49.626266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:49.626266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:49.626266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:49.626266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:49.626266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:49.626266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:49.626266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:49.626266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:49.626266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:49.626266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:49.626266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:49.626266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:49.626266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:49.626266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:49.627385 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:47:49.627385 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:47:49.627385 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:47:49.627385 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:47:49.627385 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:47:49.627385 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:47:49.627385 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:49.627385 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:49.630222 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 303/605] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:49.636280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe206f6e-0a79-4beb-a9a4-9cdc3204ecb4 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:49.636411 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 303/606] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:47:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:49.637965 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbfa9b-3e8c-4a1d-9cbd-ea785ddea901 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:49.734857 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbfa9b-3e8c-4a1d-9cbd-ea785ddea901 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:49.757517 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe206f6e-0a79-4beb-a9a4-9cdc3204ecb4 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:49.777363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1565d1-09ee-418b-97d9-18f2799c0bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:49.778508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1565d1-09ee-418b-97d9-18f2799c0bf1 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:49.778788 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1565d1-09ee-418b-97d9-18f2799c0bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:49.779061 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1565d1-09ee-418b-97d9-18f2799c0bf1 None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:49.779848 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1565d1-09ee-418b-97d9-18f2799c0bf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:49.780154 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1565d1-09ee-418b-97d9-18f2799c0bf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:49.781567 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1565d1-09ee-418b-97d9-18f2799c0bf1 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:49.791335 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d62b9d-1f1e-416a-aaec-4a6ecd753eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:49.792401 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d62b9d-1f1e-416a-aaec-4a6ecd753eae None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:49.792888 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d62b9d-1f1e-416a-aaec-4a6ecd753eae None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:49.793356 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d62b9d-1f1e-416a-aaec-4a6ecd753eae None admin] PATH_INFO: `/v3/roles/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:49.798081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 304/607] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:47:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:49.798935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1565d1-09ee-418b-97d9-18f2799c0bf1 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:49.804685 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d62b9d-1f1e-416a-aaec-4a6ecd753eae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:49.812704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-75d62b9d-1f1e-416a-aaec-4a6ecd753eae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:49.812704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:49.812704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:49.812704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:49.812704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:49.812704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:49.812704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:49.812704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:49.812704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:49.812704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:49.812704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:49.812704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:49.812704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:49.812704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:49.812704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:49.812704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:49.813620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:49.813620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:49.813620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:49.813620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:49.813620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:49.813620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:49.813620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:49.813620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:49.813620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:49.813620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:49.813620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:49.813620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:49.813620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:49.813620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:49.813620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:49.813620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:49.814475 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:49.814475 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:49.814475 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:49.814475 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:49.814475 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:49.814475 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:49.814475 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:49.814475 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:49.814475 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:49.814475 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:49.814475 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:49.814475 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:49.821650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 304/608] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:49.822833 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d62b9d-1f1e-416a-aaec-4a6ecd753eae None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:49.894620 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1565d1-09ee-418b-97d9-18f2799c0bf1 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:49.937092 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72aab0-030b-424e-91a2-8382a490a722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:49.938007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72aab0-030b-424e-91a2-8382a490a722 None admin] REQUEST_METHOD: `PUT` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:49.938286 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72aab0-030b-424e-91a2-8382a490a722 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:49.938560 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72aab0-030b-424e-91a2-8382a490a722 None admin] PATH_INFO: `/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/7eb3d5bb36f445cabb62cacf1b34984d/roles/779b01e1e2534bfba9971e7000b7c628` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:49.948536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d62b9d-1f1e-416a-aaec-4a6ecd753eae None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:49.953322 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72aab0-030b-424e-91a2-8382a490a722 None admin] RBAC: Authorizing `identity:create_grant(project_id=f395f4842c39422d962dbddc4cf2897a, user_id=7eb3d5bb36f445cabb62cacf1b34984d, role_id=779b01e1e2534bfba9971e7000b7c628)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:49.954791 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72aab0-030b-424e-91a2-8382a490a722 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:49.977818 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 305/609] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:47:49 2022] PUT /identity/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/7eb3d5bb36f445cabb62cacf1b34984d/roles/779b01e1e2534bfba9971e7000b7c628 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:47:49.977818 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72aab0-030b-424e-91a2-8382a490a722 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:50.017772 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89550ce0-01bf-44dd-ba64-a2a2694b5dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:50.019499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89550ce0-01bf-44dd-ba64-a2a2694b5dcc None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:50.019783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89550ce0-01bf-44dd-ba64-a2a2694b5dcc None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:50.020058 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89550ce0-01bf-44dd-ba64-a2a2694b5dcc None admin] PATH_INFO: `/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/f361b5ebd2b246c4bed5be82a70f63e9/roles/779b01e1e2534bfba9971e7000b7c628` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:50.059394 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89550ce0-01bf-44dd-ba64-a2a2694b5dcc None admin] RBAC: Authorizing `identity:create_grant(project_id=f395f4842c39422d962dbddc4cf2897a, user_id=f361b5ebd2b246c4bed5be82a70f63e9, role_id=779b01e1e2534bfba9971e7000b7c628)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:50.062729 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89550ce0-01bf-44dd-ba64-a2a2694b5dcc None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:50.097476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 305/610] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:47:49 2022] PUT /identity/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/f361b5ebd2b246c4bed5be82a70f63e9/roles/779b01e1e2534bfba9971e7000b7c628 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:47:50.158316 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72aab0-030b-424e-91a2-8382a490a722 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:50.202779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff3c69-da7a-4d08-a7ec-ad5857071a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:50.203463 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff3c69-da7a-4d08-a7ec-ad5857071a73 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:50.203802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff3c69-da7a-4d08-a7ec-ad5857071a73 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:50.204078 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff3c69-da7a-4d08-a7ec-ad5857071a73 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:50.204828 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff3c69-da7a-4d08-a7ec-ad5857071a73 None admin] RBAC: Adding query filter params (name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:50.205130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff3c69-da7a-4d08-a7ec-ad5857071a73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:50.206534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff3c69-da7a-4d08-a7ec-ad5857071a73 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:50.216080 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 306/611] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:47:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:50.221913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89550ce0-01bf-44dd-ba64-a2a2694b5dcc None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:50.358959 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89550ce0-01bf-44dd-ba64-a2a2694b5dcc None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:50.398072 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909f4c6-9783-45d5-8173-27d53c574bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:50.398950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909f4c6-9783-45d5-8173-27d53c574bb0 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:50.399315 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909f4c6-9783-45d5-8173-27d53c574bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:50.399590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909f4c6-9783-45d5-8173-27d53c574bb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:50.411459 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909f4c6-9783-45d5-8173-27d53c574bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:50.412858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909f4c6-9783-45d5-8173-27d53c574bb0 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:50.432427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-2909f4c6-9783-45d5-8173-27d53c574bb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:50.432427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:50.432427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:50.432427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:50.432427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:50.432427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:50.432427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:50.432427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:50.432427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:50.432427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:50.432427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:50.432427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:50.432427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:50.432427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:50.432427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:50.433424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:50.433424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:50.433424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:50.433424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:50.433424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:50.433424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:50.433424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:50.433424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:50.433424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:50.433424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:50.433424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:50.433424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:50.433424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:50.433424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:50.433424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:50.433424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:50.433424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:50.434422 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:50.434422 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:50.434422 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:50.434422 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:50.434422 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 306/612] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:50.440627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff3c69-da7a-4d08-a7ec-ad5857071a73 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:50.540892 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff3c69-da7a-4d08-a7ec-ad5857071a73 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:50.576635 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c07a38-7e96-4e93-b516-f91288e61775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:50.577303 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c07a38-7e96-4e93-b516-f91288e61775 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:50.577579 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c07a38-7e96-4e93-b516-f91288e61775 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:50.577879 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c07a38-7e96-4e93-b516-f91288e61775 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:50.578602 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c07a38-7e96-4e93-b516-f91288e61775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:50.578907 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c07a38-7e96-4e93-b516-f91288e61775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:50.580373 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c07a38-7e96-4e93-b516-f91288e61775 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:50.593620 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 307/613] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:50.598972 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909f4c6-9783-45d5-8173-27d53c574bb0 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:50.600732 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce739cdb-8efc-4a83-9788-ecdb66951671 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:50.601014 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce739cdb-8efc-4a83-9788-ecdb66951671 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:50.601657 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce739cdb-8efc-4a83-9788-ecdb66951671 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:50.603134 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 308/614] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:50.613961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc9a66-e8e5-47ad-9774-9e9ecd89480c None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:50.614246 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc9a66-e8e5-47ad-9774-9e9ecd89480c None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:50.614520 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc9a66-e8e5-47ad-9774-9e9ecd89480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:50.630775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-00cc9a66-e8e5-47ad-9774-9e9ecd89480c None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:50.631934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-00cc9a66-e8e5-47ad-9774-9e9ecd89480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:50.698005 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 309/615] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:47:50.712571 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909f4c6-9783-45d5-8173-27d53c574bb0 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:50.736468 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc9a66-e8e5-47ad-9774-9e9ecd89480c None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:50.756360 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed1a10-c963-408a-98f4-c0050273d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:50.757157 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed1a10-c963-408a-98f4-c0050273d20f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:50.757461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed1a10-c963-408a-98f4-c0050273d20f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:50.757734 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed1a10-c963-408a-98f4-c0050273d20f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:50.768945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed1a10-c963-408a-98f4-c0050273d20f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:50.770418 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed1a10-c963-408a-98f4-c0050273d20f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:50.798180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-e9ed1a10-c963-408a-98f4-c0050273d20f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 09:47:50.798180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:50.798180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:50.798180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:50.798180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:50.798180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:50.798180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:50.798180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:50.798180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:50.798180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:50.798180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:50.798180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:50.798180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:47:50.798180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:47:50.798180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:47:50.798180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:50.800346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:50.802548 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:50.802548 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:50.802548 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:47:50.802548 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:47:50.802548 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:47:50.802548 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:47:50.802548 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:47:50.802548 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:47:50.802548 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 09:47:50.802548 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:50.802548 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 307/616] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 3 09:47:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:50.809582 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed1a10-c963-408a-98f4-c0050273d20f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:50.935544 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed1a10-c963-408a-98f4-c0050273d20f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:50.947670 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc9a66-e8e5-47ad-9774-9e9ecd89480c None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:50.972311 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e95591-4c5b-4b3a-b274-2bdc253ad844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:50.972899 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e95591-4c5b-4b3a-b274-2bdc253ad844 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:50.973329 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e95591-4c5b-4b3a-b274-2bdc253ad844 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:50.973605 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e95591-4c5b-4b3a-b274-2bdc253ad844 None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:50.974482 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e95591-4c5b-4b3a-b274-2bdc253ad844 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:50.974785 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e95591-4c5b-4b3a-b274-2bdc253ad844 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:50.976271 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e95591-4c5b-4b3a-b274-2bdc253ad844 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:50.995397 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 308/617] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 3 09:47:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:51.006830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e95591-4c5b-4b3a-b274-2bdc253ad844 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:51.019063 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc720ed-b678-445b-b681-bab5f085a312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:51.019063 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc720ed-b678-445b-b681-bab5f085a312 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:51.019063 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc720ed-b678-445b-b681-bab5f085a312 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:51.019063 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc720ed-b678-445b-b681-bab5f085a312 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:51.050710 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc720ed-b678-445b-b681-bab5f085a312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:51.065007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-cdc720ed-b678-445b-b681-bab5f085a312 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:51.065007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:51.065007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:51.065007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:51.065007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:51.065007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:51.065007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:51.065007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:51.065007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:51.065007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:51.065007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:51.065007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:51.065007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:51.065007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:51.065007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:51.065007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:51.066002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:51.066002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:51.066002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:51.066002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:51.066002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:51.066002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:51.066002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:51.066002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:51.066002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:51.066002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:51.066002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:51.066002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:51.066002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:51.066002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:51.066002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:51.066002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:51.066841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:51.066841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:51.066841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:51.066841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:51.066841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:51.066841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:51.066841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:51.066841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:51.066841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:51.066841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:51.066841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:51.066841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:51.069633 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 310/618] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:51.075596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc720ed-b678-445b-b681-bab5f085a312 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:51.133913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e95591-4c5b-4b3a-b274-2bdc253ad844 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:51.174576 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f6e6c-9fbf-4ac3-9b9f-6384ce048af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:51.175233 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f6e6c-9fbf-4ac3-9b9f-6384ce048af5 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:51.175509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f6e6c-9fbf-4ac3-9b9f-6384ce048af5 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:51.175780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f6e6c-9fbf-4ac3-9b9f-6384ce048af5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:51.265014 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc720ed-b678-445b-b681-bab5f085a312 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:51.306298 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34f335-41cf-4ef5-a721-cf8fd505ae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:51.306973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34f335-41cf-4ef5-a721-cf8fd505ae14 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:51.307443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34f335-41cf-4ef5-a721-cf8fd505ae14 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:51.307723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34f335-41cf-4ef5-a721-cf8fd505ae14 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:51.308517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34f335-41cf-4ef5-a721-cf8fd505ae14 None admin] RBAC: Adding query filter params (name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:51.308869 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34f335-41cf-4ef5-a721-cf8fd505ae14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:51.310307 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34f335-41cf-4ef5-a721-cf8fd505ae14 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:51.319924 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 311/619] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:47:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:51.325327 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34f335-41cf-4ef5-a721-cf8fd505ae14 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:51.331346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f6e6c-9fbf-4ac3-9b9f-6384ce048af5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:51.332807 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f6e6c-9fbf-4ac3-9b9f-6384ce048af5 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:51.508665 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34f335-41cf-4ef5-a721-cf8fd505ae14 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:51.528989 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 309/620] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:51.534428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f6e6c-9fbf-4ac3-9b9f-6384ce048af5 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:51.541765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba115f-0050-466b-be91-7ccbc7bad360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:51.542595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba115f-0050-466b-be91-7ccbc7bad360 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:51.542873 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba115f-0050-466b-be91-7ccbc7bad360 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:51.543144 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba115f-0050-466b-be91-7ccbc7bad360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:51.553863 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba115f-0050-466b-be91-7ccbc7bad360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:51.555373 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba115f-0050-466b-be91-7ccbc7bad360 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:51.572130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-61ba115f-0050-466b-be91-7ccbc7bad360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:51.572130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:51.572130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:51.572130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:51.572130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:51.572130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:51.572130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:51.572130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:51.572130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:51.572130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:51.572130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:51.572130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:51.572130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:51.572130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:51.572130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:51.573103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:51.573103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:51.573103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:51.573103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:51.573103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:51.573103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:51.573103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:51.573103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:51.573103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:51.573103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:51.573103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:51.573103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:51.573103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:51.573103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:51.573103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:51.573103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:51.573103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:51.574023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:51.574023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:51.574023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:51.574023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:51.574023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 312/621] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:51.582726 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba115f-0050-466b-be91-7ccbc7bad360 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:51.645543 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f6e6c-9fbf-4ac3-9b9f-6384ce048af5 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:51.691393 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e457a5a-fa75-4c8e-a513-4a39aa14cb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:51.692201 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e457a5a-fa75-4c8e-a513-4a39aa14cb35 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:51.692482 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e457a5a-fa75-4c8e-a513-4a39aa14cb35 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:51.692756 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e457a5a-fa75-4c8e-a513-4a39aa14cb35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:51.713953 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e457a5a-fa75-4c8e-a513-4a39aa14cb35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:51.715438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e457a5a-fa75-4c8e-a513-4a39aa14cb35 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:51.743583 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba115f-0050-466b-be91-7ccbc7bad360 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:51.755328 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-3e457a5a-fa75-4c8e-a513-4a39aa14cb35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:51.755328 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:51.755328 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:51.755328 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:51.755328 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:51.755328 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:51.755328 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:51.755328 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:51.755328 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:51.755328 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:51.755328 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:51.755328 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:51.755328 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:51.755328 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:51.755328 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:51.757420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:51.757420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:51.757420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:51.757420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:51.757420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:51.757420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:51.757420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:51.757420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:51.757420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:51.757420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:51.757420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:51.757420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:51.757420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:51.757420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:51.757420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:51.757420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:51.757420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:51.759821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:51.759821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:51.759821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:51.759821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:51.759821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 310/622] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:51.765729 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e457a5a-fa75-4c8e-a513-4a39aa14cb35 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:51.826711 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046bbe7-cdee-4717-bedb-529d1ce88cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:51.827214 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046bbe7-cdee-4717-bedb-529d1ce88cdb None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:51.827499 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046bbe7-cdee-4717-bedb-529d1ce88cdb None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:51.827776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046bbe7-cdee-4717-bedb-529d1ce88cdb None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:51.828552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046bbe7-cdee-4717-bedb-529d1ce88cdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:51.828804 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046bbe7-cdee-4717-bedb-529d1ce88cdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:51.830263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046bbe7-cdee-4717-bedb-529d1ce88cdb None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:51.853324 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 313/623] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:51.869812 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046bbe7-cdee-4717-bedb-529d1ce88cdb None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:51.872462 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e457a5a-fa75-4c8e-a513-4a39aa14cb35 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:51.916048 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978d113-9635-4c4b-881e-8312f4bf1ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:51.917093 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978d113-9635-4c4b-881e-8312f4bf1ba0 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:51.917569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978d113-9635-4c4b-881e-8312f4bf1ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:51.918138 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978d113-9635-4c4b-881e-8312f4bf1ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:51.919058 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978d113-9635-4c4b-881e-8312f4bf1ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:51.919549 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978d113-9635-4c4b-881e-8312f4bf1ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:51.921112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978d113-9635-4c4b-881e-8312f4bf1ba0 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:51.941394 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 311/624] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:51.947033 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978d113-9635-4c4b-881e-8312f4bf1ba0 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:51.981035 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046bbe7-cdee-4717-bedb-529d1ce88cdb None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:52.014455 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b577cf-1be9-47f5-94ff-b83e5157594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:52.015254 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b577cf-1be9-47f5-94ff-b83e5157594f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:52.015530 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b577cf-1be9-47f5-94ff-b83e5157594f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:52.015795 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b577cf-1be9-47f5-94ff-b83e5157594f None admin] PATH_INFO: `/v3/users/swift` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:52.023152 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b577cf-1be9-47f5-94ff-b83e5157594f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:52.024618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b577cf-1be9-47f5-94ff-b83e5157594f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:52.039425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-29b577cf-1be9-47f5-94ff-b83e5157594f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 09:47:52.039425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:52.039425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:52.039425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:52.039425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:52.039425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:52.039425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:52.039425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:52.039425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:52.039425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:52.039425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:52.039425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:52.039425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:47:52.039425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:47:52.039425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:47:52.039425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:52.040406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:52.041329 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:52.041329 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:52.041329 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:47:52.041329 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:47:52.041329 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:47:52.041329 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:47:52.041329 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:47:52.041329 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:47:52.041329 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 09:47:52.041329 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:52.045208 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 314/625] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:47:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:52.046580 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb7120-1d4f-4752-b098-9fa96044c7a3 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:52.046866 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb7120-1d4f-4752-b098-9fa96044c7a3 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:52.047160 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb7120-1d4f-4752-b098-9fa96044c7a3 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:52.048853 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 315/626] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:52.049855 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb7120-1d4f-4752-b098-9fa96044c7a3 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:52.055580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978d113-9635-4c4b-881e-8312f4bf1ba0 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:52.088490 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc7701-0549-4bb7-be33-b5c0da74d566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:52.089518 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc7701-0549-4bb7-be33-b5c0da74d566 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:52.089977 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc7701-0549-4bb7-be33-b5c0da74d566 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:52.090410 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc7701-0549-4bb7-be33-b5c0da74d566 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:52.097506 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc7701-0549-4bb7-be33-b5c0da74d566 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:52.099155 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc7701-0549-4bb7-be33-b5c0da74d566 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:52.113990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-3dbc7701-0549-4bb7-be33-b5c0da74d566 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:52.113990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:52.113990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:52.113990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:52.113990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:52.113990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:52.113990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:52.113990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:52.113990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:52.113990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:52.113990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:52.113990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:52.113990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:47:52.113990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:47:52.113990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:47:52.114922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:47:52.114922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:52.114922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:52.114922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:52.114922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:52.114922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:52.114922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:52.114922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:52.114922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:52.114922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:52.114922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:52.114922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:52.114922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:52.114922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:52.114922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:52.114922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:52.114922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:52.115784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:47:52.115784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:47:52.115784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:47:52.115784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:47:52.115784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:47:52.115784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:47:52.115784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:52.115784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:52.118305 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 312/627] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:52.124384 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0a59-86bb-4923-8ff4-fa59a27a8725 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:52.124922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0a59-86bb-4923-8ff4-fa59a27a8725 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:52.125397 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0a59-86bb-4923-8ff4-fa59a27a8725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:52.142413 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-e9dd0a59-86bb-4923-8ff4-fa59a27a8725 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:52.143887 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-e9dd0a59-86bb-4923-8ff4-fa59a27a8725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:52.154246 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb7120-1d4f-4752-b098-9fa96044c7a3 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:52.188492 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4ba8a-f4d7-41f0-b339-ae791b3e4ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:52.189166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4ba8a-f4d7-41f0-b339-ae791b3e4ed4 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:52.189491 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4ba8a-f4d7-41f0-b339-ae791b3e4ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:52.189767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4ba8a-f4d7-41f0-b339-ae791b3e4ed4 None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:52.190821 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4ba8a-f4d7-41f0-b339-ae791b3e4ed4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:52.191136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4ba8a-f4d7-41f0-b339-ae791b3e4ed4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:52.192629 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4ba8a-f4d7-41f0-b339-ae791b3e4ed4 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:52.211564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 313/629] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:52.212879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd0a59-86bb-4923-8ff4-fa59a27a8725 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:52.215414 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 316/629] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 3 09:47:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:52.217185 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4ba8a-f4d7-41f0-b339-ae791b3e4ed4 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:52.312480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd0a59-86bb-4923-8ff4-fa59a27a8725 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:52.313293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4ba8a-f4d7-41f0-b339-ae791b3e4ed4 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:52.346567 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad168f91-b3ec-46b5-80b0-41e78b9066cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:52.347285 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad168f91-b3ec-46b5-80b0-41e78b9066cf None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:52.347565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad168f91-b3ec-46b5-80b0-41e78b9066cf None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:52.347839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad168f91-b3ec-46b5-80b0-41e78b9066cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:52.348090 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b5028-57b7-42b5-9a32-26f193e2aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:52.349117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b5028-57b7-42b5-9a32-26f193e2aeea None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:52.349601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b5028-57b7-42b5-9a32-26f193e2aeea None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:52.350098 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b5028-57b7-42b5-9a32-26f193e2aeea None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:52.351150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b5028-57b7-42b5-9a32-26f193e2aeea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:52.351667 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b5028-57b7-42b5-9a32-26f193e2aeea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:52.353315 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b5028-57b7-42b5-9a32-26f193e2aeea None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:52.358165 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad168f91-b3ec-46b5-80b0-41e78b9066cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:52.359595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad168f91-b3ec-46b5-80b0-41e78b9066cf None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:52.366214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 314/630] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:47:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:52.367442 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b5028-57b7-42b5-9a32-26f193e2aeea None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:52.378404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-ad168f91-b3ec-46b5-80b0-41e78b9066cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:52.378404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:52.378404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:52.378404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:52.378404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:52.378404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:52.378404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:52.378404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:52.378404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:52.378404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:52.378404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:52.378404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:52.378404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:52.378404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:52.378404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:52.379446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:52.379446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:52.379446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:52.379446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:52.379446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:52.379446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:52.379446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:52.379446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:52.379446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:52.379446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:52.379446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:52.379446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:52.379446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:52.379446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:52.379446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:52.379446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:52.379446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:52.380311 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:52.380311 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:52.380311 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:52.380311 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:52.384381 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 317/631] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:52.385214 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad168f91-b3ec-46b5-80b0-41e78b9066cf None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:52.472330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b5028-57b7-42b5-9a32-26f193e2aeea None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:52.485667 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad168f91-b3ec-46b5-80b0-41e78b9066cf None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:52.505599 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a063ad0-292d-481f-9f50-d6e55bbe8a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:52.506751 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a063ad0-292d-481f-9f50-d6e55bbe8a28 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:52.507240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a063ad0-292d-481f-9f50-d6e55bbe8a28 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:52.507771 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a063ad0-292d-481f-9f50-d6e55bbe8a28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:52.519052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6d232-26fe-43a1-bfc0-479e2ec43309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:52.519496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a063ad0-292d-481f-9f50-d6e55bbe8a28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:52.519704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6d232-26fe-43a1-bfc0-479e2ec43309 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:52.519983 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6d232-26fe-43a1-bfc0-479e2ec43309 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:52.520256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6d232-26fe-43a1-bfc0-479e2ec43309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:52.521088 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6d232-26fe-43a1-bfc0-479e2ec43309 None admin] RBAC: Adding query filter params (role.id=779b01e1e2534bfba9971e7000b7c628, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=efb008cfc6424998917da60d72689f55) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:52.521396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6d232-26fe-43a1-bfc0-479e2ec43309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:52.522901 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6d232-26fe-43a1-bfc0-479e2ec43309 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:52.529334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-5a063ad0-292d-481f-9f50-d6e55bbe8a28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:52.529334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:52.529334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:52.529334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:52.529334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:52.529334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:52.529334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:52.529334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:52.529334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:52.529334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:52.529334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:52.529334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:52.529334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:52.529334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:52.529334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:52.529334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:52.530629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:52.530629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:52.530629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:52.530629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:52.530629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:52.530629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:52.530629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:52.530629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:52.530629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:52.530629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:52.530629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:52.530629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:52.530629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:52.530629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:52.530629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:52.530629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:52.531438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:52.531438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:52.531438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:52.531438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:52.531438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:52.531438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:52.531438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:52.531438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:52.531438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:52.531438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:52.531438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:52.531438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:52.532175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 318/632] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:47:52 2022] GET /identity/v3/role_assignments?user.id=efb008cfc6424998917da60d72689f55&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=779b01e1e2534bfba9971e7000b7c628 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:52.532175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6d232-26fe-43a1-bfc0-479e2ec43309 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:52.535566 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 315/633] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:52.545931 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a063ad0-292d-481f-9f50-d6e55bbe8a28 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:52.634672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6d232-26fe-43a1-bfc0-479e2ec43309 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:52.671251 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d8cd0-7727-44dc-9966-4a959f9a2881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:52.671935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d8cd0-7727-44dc-9966-4a959f9a2881 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:52.672216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d8cd0-7727-44dc-9966-4a959f9a2881 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:52.672489 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d8cd0-7727-44dc-9966-4a959f9a2881 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:52.673245 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d8cd0-7727-44dc-9966-4a959f9a2881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:52.673551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d8cd0-7727-44dc-9966-4a959f9a2881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:52.675055 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d8cd0-7727-44dc-9966-4a959f9a2881 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:52.688184 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 319/634] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:52.689658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b1c3f-4db1-4eea-8a62-8855e2916074 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:52.689976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b1c3f-4db1-4eea-8a62-8855e2916074 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:52.690250 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b1c3f-4db1-4eea-8a62-8855e2916074 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:52.696513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 320/635] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:52.698069 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b1c3f-4db1-4eea-8a62-8855e2916074 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:52.716459 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a063ad0-292d-481f-9f50-d6e55bbe8a28 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:52.753006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714b63c-4679-48b7-829c-1511ed583cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:52.754107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714b63c-4679-48b7-829c-1511ed583cdb None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:52.754608 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714b63c-4679-48b7-829c-1511ed583cdb None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:52.755094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714b63c-4679-48b7-829c-1511ed583cdb None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:52.756057 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714b63c-4679-48b7-829c-1511ed583cdb None admin] RBAC: Adding query filter params (name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:52.756574 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714b63c-4679-48b7-829c-1511ed583cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:52.758984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714b63c-4679-48b7-829c-1511ed583cdb None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:52.768033 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 316/636] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:47:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:52.769724 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aedc68-9734-43cd-a262-dfde4c4f4634 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:52.770233 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aedc68-9734-43cd-a262-dfde4c4f4634 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:52.770704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aedc68-9734-43cd-a262-dfde4c4f4634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:52.790881 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-e9aedc68-9734-43cd-a262-dfde4c4f4634 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:52.792854 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-e9aedc68-9734-43cd-a262-dfde4c4f4634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:52.809038 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b1c3f-4db1-4eea-8a62-8855e2916074 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:52.851420 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12210c93-b19f-4adc-b66c-56216e8a225c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:52.851930 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12210c93-b19f-4adc-b66c-56216e8a225c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:52.852810 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12210c93-b19f-4adc-b66c-56216e8a225c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:52.852810 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12210c93-b19f-4adc-b66c-56216e8a225c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:52.863266 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12210c93-b19f-4adc-b66c-56216e8a225c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:52.865423 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12210c93-b19f-4adc-b66c-56216e8a225c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:52.881488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-12210c93-b19f-4adc-b66c-56216e8a225c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:52.881488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:52.881488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:52.881488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:52.881488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:52.881488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:52.881488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:52.881488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:52.881488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:52.881488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:52.881488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:52.881488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:52.881488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:47:52.881488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:47:52.881488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:47:52.882604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:47:52.882604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:52.882604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:52.882604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:52.882604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:52.882604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:52.882604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:52.882604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:52.882604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:52.882604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:52.882604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:52.882604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:52.882604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:52.882604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:52.882604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:52.882604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:52.882604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:52.883793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:47:52.883793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:47:52.883793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:47:52.883793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:47:52.883793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:47:52.883793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:47:52.883793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:52.883793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:52.883793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 321/637] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:52.884288 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 317/638] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:52.884361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12210c93-b19f-4adc-b66c-56216e8a225c None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:52.885612 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec9d27-bf45-4f16-93c1-681c8f3404a6 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:52.885868 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec9d27-bf45-4f16-93c1-681c8f3404a6 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:52.886150 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec9d27-bf45-4f16-93c1-681c8f3404a6 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:52.887620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 318/639] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:52.892710 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f9a75-563c-4b17-b5bd-933bc869e852 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:52.892984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f9a75-563c-4b17-b5bd-933bc869e852 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:52.893260 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f9a75-563c-4b17-b5bd-933bc869e852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:52.911002 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-3a7f9a75-563c-4b17-b5bd-933bc869e852 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:52.912169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-3a7f9a75-563c-4b17-b5bd-933bc869e852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:52.985882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 319/640] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:47:52.985882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f9a75-563c-4b17-b5bd-933bc869e852 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:53.012816 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12210c93-b19f-4adc-b66c-56216e8a225c None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:53.045227 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7e015-7d26-4be1-b860-6ca3ddf18674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:53.046381 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7e015-7d26-4be1-b860-6ca3ddf18674 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:53.046664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7e015-7d26-4be1-b860-6ca3ddf18674 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:53.046935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7e015-7d26-4be1-b860-6ca3ddf18674 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:53.057372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7e015-7d26-4be1-b860-6ca3ddf18674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:53.058835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7e015-7d26-4be1-b860-6ca3ddf18674 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:53.075241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-a3a7e015-7d26-4be1-b860-6ca3ddf18674 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:53.075241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:53.075241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:53.075241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:53.075241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:53.075241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:53.075241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:53.075241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:53.075241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:53.075241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:53.075241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:53.075241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:53.075241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:53.075241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:53.075241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:53.076355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:53.076355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:53.076355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:53.076355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:53.076355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:53.076355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:53.076355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:53.076355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:53.076355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:53.076355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:53.076355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:53.076355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:53.076355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:53.076355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:53.076355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:53.076355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:53.076355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:53.077238 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:53.077238 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:53.077238 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:53.077238 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:53.077238 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 322/641] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:53.077238 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7e015-7d26-4be1-b860-6ca3ddf18674 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:53.083418 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f9a75-563c-4b17-b5bd-933bc869e852 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:53.116404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3e5e1-b4d9-4953-a3bb-8781026cb42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:53.117465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3e5e1-b4d9-4953-a3bb-8781026cb42a None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:53.117942 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3e5e1-b4d9-4953-a3bb-8781026cb42a None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:53.119542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3e5e1-b4d9-4953-a3bb-8781026cb42a None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:53.120480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3e5e1-b4d9-4953-a3bb-8781026cb42a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:53.120927 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3e5e1-b4d9-4953-a3bb-8781026cb42a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:53.122526 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3e5e1-b4d9-4953-a3bb-8781026cb42a None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:53.135331 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 320/642] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:47:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:53.136438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3e5e1-b4d9-4953-a3bb-8781026cb42a None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:53.178874 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7e015-7d26-4be1-b860-6ca3ddf18674 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:53.211378 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44c756-a195-441d-9a4b-3eadcd80df8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:53.212339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44c756-a195-441d-9a4b-3eadcd80df8a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:53.212608 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44c756-a195-441d-9a4b-3eadcd80df8a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:53.212879 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44c756-a195-441d-9a4b-3eadcd80df8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:53.222638 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44c756-a195-441d-9a4b-3eadcd80df8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:53.230765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-ed44c756-a195-441d-9a4b-3eadcd80df8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:53.230765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:53.230765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:53.230765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:53.230765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:53.230765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:53.230765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:53.230765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:53.230765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:53.230765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:53.230765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:53.230765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:53.230765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:53.230765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:53.230765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:53.230765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:53.231759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:53.231759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:53.231759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:53.231759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:53.231759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:53.231759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:53.231759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:53.231759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:53.231759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:53.231759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:53.231759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:53.231759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:53.231759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:53.231759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:53.231759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:53.231759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:53.232683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:53.232683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:53.232683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:53.232683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:53.232683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:53.232683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:53.232683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:53.232683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:53.232683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:53.232683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:53.232683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:53.232683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:53.233963 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3e5e1-b4d9-4953-a3bb-8781026cb42a None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:53.236875 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 323/643] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:53.237733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44c756-a195-441d-9a4b-3eadcd80df8a None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:53.275823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220c743-cf4a-4107-a1b6-0365b3331ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:53.276721 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220c743-cf4a-4107-a1b6-0365b3331ecd None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:53.277008 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220c743-cf4a-4107-a1b6-0365b3331ecd None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:53.277280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220c743-cf4a-4107-a1b6-0365b3331ecd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:53.287512 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220c743-cf4a-4107-a1b6-0365b3331ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:53.295219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-a220c743-cf4a-4107-a1b6-0365b3331ecd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:53.295219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:53.295219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:53.295219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:53.295219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:53.295219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:53.295219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:53.295219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:53.295219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:53.295219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:53.295219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:53.295219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:53.295219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:53.295219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:53.295219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:53.295219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:53.296147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:53.296147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:53.296147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:53.296147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:53.296147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:53.296147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:53.296147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:53.296147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:53.296147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:53.296147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:53.296147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:53.296147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:53.296147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:53.296147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:53.296147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:53.296147 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:53.297037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:53.297037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:53.297037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:53.297037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:53.297037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:53.297037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:53.297037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:53.297037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:53.297037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:53.297037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:53.297037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:53.297037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:53.297037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 321/644] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:53.297756 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220c743-cf4a-4107-a1b6-0365b3331ecd None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:53.359199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44c756-a195-441d-9a4b-3eadcd80df8a None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:53.391933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1869e5-943c-4acf-8358-96c7a2a7f01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:53.392519 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1869e5-943c-4acf-8358-96c7a2a7f01b None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:53.392797 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1869e5-943c-4acf-8358-96c7a2a7f01b None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:53.393080 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1869e5-943c-4acf-8358-96c7a2a7f01b None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:53.393822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1869e5-943c-4acf-8358-96c7a2a7f01b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:53.394127 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1869e5-943c-4acf-8358-96c7a2a7f01b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:53.395142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220c743-cf4a-4107-a1b6-0365b3331ecd None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:53.395497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1869e5-943c-4acf-8358-96c7a2a7f01b None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:53.412916 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 324/645] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:53.412916 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1869e5-943c-4acf-8358-96c7a2a7f01b None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:53.433070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8978d16-b986-4b1f-b020-1177da5378f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:53.434012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8978d16-b986-4b1f-b020-1177da5378f6 None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:53.434293 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8978d16-b986-4b1f-b020-1177da5378f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:53.434563 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8978d16-b986-4b1f-b020-1177da5378f6 None admin] PATH_INFO: `/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/73dfc1b485d647f1ae59a405c978599f/roles/779b01e1e2534bfba9971e7000b7c628` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:53.448830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8978d16-b986-4b1f-b020-1177da5378f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f395f4842c39422d962dbddc4cf2897a, user_id=73dfc1b485d647f1ae59a405c978599f, role_id=779b01e1e2534bfba9971e7000b7c628)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:53.450316 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8978d16-b986-4b1f-b020-1177da5378f6 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:53.464014 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 322/646] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:47:53 2022] PUT /identity/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/73dfc1b485d647f1ae59a405c978599f/roles/779b01e1e2534bfba9971e7000b7c628 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:47:53.465207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8978d16-b986-4b1f-b020-1177da5378f6 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:53.511996 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1869e5-943c-4acf-8358-96c7a2a7f01b None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:53.550473 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fb137-7bac-4633-8ada-a552c0f5c5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:53.551662 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fb137-7bac-4633-8ada-a552c0f5c5c9 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:53.552136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fb137-7bac-4633-8ada-a552c0f5c5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:53.552618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fb137-7bac-4633-8ada-a552c0f5c5c9 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:53.553664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fb137-7bac-4633-8ada-a552c0f5c5c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:53.554298 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fb137-7bac-4633-8ada-a552c0f5c5c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:53.556008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fb137-7bac-4633-8ada-a552c0f5c5c9 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:53.565653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 325/647] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:47:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:53.567018 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fb137-7bac-4633-8ada-a552c0f5c5c9 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:53.572876 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8978d16-b986-4b1f-b020-1177da5378f6 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:53.608965 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00586e-cd0b-40a1-ba3a-b2a504e19955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:53.609821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00586e-cd0b-40a1-ba3a-b2a504e19955 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:53.610229 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00586e-cd0b-40a1-ba3a-b2a504e19955 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:53.610877 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00586e-cd0b-40a1-ba3a-b2a504e19955 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:53.611475 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00586e-cd0b-40a1-ba3a-b2a504e19955 None admin] RBAC: Adding query filter params (name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:53.611878 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00586e-cd0b-40a1-ba3a-b2a504e19955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:53.613413 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00586e-cd0b-40a1-ba3a-b2a504e19955 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:53.622923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 323/648] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:47:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:53.623987 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00586e-cd0b-40a1-ba3a-b2a504e19955 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:53.676133 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fb137-7bac-4633-8ada-a552c0f5c5c9 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:53.713426 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5ffec-8546-4868-8281-2f1fb2e688a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:53.714414 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5ffec-8546-4868-8281-2f1fb2e688a5 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:53.714801 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5ffec-8546-4868-8281-2f1fb2e688a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:53.715157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5ffec-8546-4868-8281-2f1fb2e688a5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:53.723102 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5ffec-8546-4868-8281-2f1fb2e688a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:53.724657 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5ffec-8546-4868-8281-2f1fb2e688a5 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:53.738181 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00586e-cd0b-40a1-ba3a-b2a504e19955 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:53.740960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-9fb5ffec-8546-4868-8281-2f1fb2e688a5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 09:47:53.740960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:53.740960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:53.740960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:53.740960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:53.740960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:53.740960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:53.740960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:53.740960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:53.740960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:53.740960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:53.740960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:53.740960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:47:53.740960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:47:53.740960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:47:53.740960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:53.742189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:53.743348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:53.743348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:53.743348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:47:53.743348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:47:53.743348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:47:53.743348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:47:53.743348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:47:53.743348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:47:53.743348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 09:47:53.743348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:53.749402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 326/649] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:53.749402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5ffec-8546-4868-8281-2f1fb2e688a5 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:53.786316 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb756814-ab07-4f75-9757-7c8b792d3a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:53.787363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb756814-ab07-4f75-9757-7c8b792d3a78 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:53.788229 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb756814-ab07-4f75-9757-7c8b792d3a78 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:53.788692 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb756814-ab07-4f75-9757-7c8b792d3a78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:53.802213 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb756814-ab07-4f75-9757-7c8b792d3a78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:53.804909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb756814-ab07-4f75-9757-7c8b792d3a78 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:53.827074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-cb756814-ab07-4f75-9757-7c8b792d3a78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:53.827074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:53.827074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:53.827074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:53.827074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:53.827074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:53.827074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:53.827074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:53.827074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:53.827074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:53.827074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:53.827074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:53.827074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:53.827074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:53.827074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:53.828303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:53.828303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:53.828303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:53.828303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:53.828303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:53.828303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:53.828303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:53.828303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:53.828303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:53.828303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:53.828303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:53.828303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:53.828303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:53.828303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:53.828303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:53.828303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:53.828303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:53.829409 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:53.829409 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:53.829409 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:53.829409 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:53.831771 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 324/650] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:53.832893 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb756814-ab07-4f75-9757-7c8b792d3a78 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:53.860277 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5ffec-8546-4868-8281-2f1fb2e688a5 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:53.902482 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ac890-6e3c-46e3-a484-f234d2320d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:53.903720 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ac890-6e3c-46e3-a484-f234d2320d2d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:53.904137 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ac890-6e3c-46e3-a484-f234d2320d2d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:53.905009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ac890-6e3c-46e3-a484-f234d2320d2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:53.917883 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ac890-6e3c-46e3-a484-f234d2320d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:53.919835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ac890-6e3c-46e3-a484-f234d2320d2d None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:53.937657 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb756814-ab07-4f75-9757-7c8b792d3a78 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:53.941839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-9d0ac890-6e3c-46e3-a484-f234d2320d2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:53.941839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:53.941839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:53.941839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:53.941839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:53.941839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:53.941839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:53.941839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:53.941839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:53.941839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:53.941839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:53.941839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:53.941839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:53.941839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:53.941839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:53.942822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:53.942822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:53.942822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:53.942822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:53.942822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:53.942822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:53.942822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:53.942822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:53.942822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:53.942822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:53.942822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:53.942822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:53.942822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:53.942822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:53.942822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:53.942822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:53.942822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:53.943912 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:53.943912 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:53.943912 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:53.943912 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:53.945868 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 327/651] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:53.946869 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ac890-6e3c-46e3-a484-f234d2320d2d None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:53.976860 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd293eb9-5277-415b-a96a-9c28a1615737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:53.977782 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd293eb9-5277-415b-a96a-9c28a1615737 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:53.978073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd293eb9-5277-415b-a96a-9c28a1615737 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:53.978439 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd293eb9-5277-415b-a96a-9c28a1615737 None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:53.979362 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd293eb9-5277-415b-a96a-9c28a1615737 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:53.979765 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd293eb9-5277-415b-a96a-9c28a1615737 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:53.981293 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd293eb9-5277-415b-a96a-9c28a1615737 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:54.003830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 325/652] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 3 09:47:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:54.003830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd293eb9-5277-415b-a96a-9c28a1615737 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:54.055831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ac890-6e3c-46e3-a484-f234d2320d2d None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:54.093936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405ee26-392a-4a16-ab61-4810f1eaa2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:54.095138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405ee26-392a-4a16-ab61-4810f1eaa2a6 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:54.095822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405ee26-392a-4a16-ab61-4810f1eaa2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:54.096266 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405ee26-392a-4a16-ab61-4810f1eaa2a6 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:54.097276 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405ee26-392a-4a16-ab61-4810f1eaa2a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:54.097730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405ee26-392a-4a16-ab61-4810f1eaa2a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:54.099906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405ee26-392a-4a16-ab61-4810f1eaa2a6 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:54.115241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd293eb9-5277-415b-a96a-9c28a1615737 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:54.115675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 328/653] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:54.116980 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405ee26-392a-4a16-ab61-4810f1eaa2a6 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:54.162044 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527503a-ce61-4121-b018-abf9c718dae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:54.163312 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527503a-ce61-4121-b018-abf9c718dae0 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:54.163943 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527503a-ce61-4121-b018-abf9c718dae0 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:54.164470 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527503a-ce61-4121-b018-abf9c718dae0 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:54.165480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527503a-ce61-4121-b018-abf9c718dae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:54.165960 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527503a-ce61-4121-b018-abf9c718dae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:54.167759 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527503a-ce61-4121-b018-abf9c718dae0 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:54.186569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 326/654] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:54.187734 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527503a-ce61-4121-b018-abf9c718dae0 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:54.234055 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405ee26-392a-4a16-ab61-4810f1eaa2a6 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:54.279904 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ce477-0ab8-4242-b750-c185d347b8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:54.280556 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ce477-0ab8-4242-b750-c185d347b8de None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:54.280976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ce477-0ab8-4242-b750-c185d347b8de None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:54.281261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ce477-0ab8-4242-b750-c185d347b8de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:54.303189 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527503a-ce61-4121-b018-abf9c718dae0 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:54.337264 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e69ccb-47c6-411b-b36e-2e4553306862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:54.338181 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69ccb-47c6-411b-b36e-2e4553306862 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:54.338460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69ccb-47c6-411b-b36e-2e4553306862 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:54.338772 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69ccb-47c6-411b-b36e-2e4553306862 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:54.346587 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e69ccb-47c6-411b-b36e-2e4553306862 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:54.348076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e69ccb-47c6-411b-b36e-2e4553306862 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:54.352604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ce477-0ab8-4242-b750-c185d347b8de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:54.354407 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ce477-0ab8-4242-b750-c185d347b8de None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:54.365823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-72e69ccb-47c6-411b-b36e-2e4553306862 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 09:47:54.365823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:54.365823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:54.365823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:54.365823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:54.365823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:54.365823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:54.365823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:54.365823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:54.365823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:54.365823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:54.365823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:54.365823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:47:54.365823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:47:54.365823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:47:54.365823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:54.366844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:54.367933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:54.367933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:54.367933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:47:54.367933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:47:54.367933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:47:54.367933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:47:54.367933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:47:54.367933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:47:54.367933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 09:47:54.367933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:54.370062 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 327/655] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:54.370225 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e69ccb-47c6-411b-b36e-2e4553306862 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:54.463081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 329/656] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:54.463680 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ce477-0ab8-4242-b750-c185d347b8de None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:54.499945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e69ccb-47c6-411b-b36e-2e4553306862 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:54.544401 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610143b8-7640-4550-895d-d6c2729dcf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:54.545666 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610143b8-7640-4550-895d-d6c2729dcf5f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:54.546073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610143b8-7640-4550-895d-d6c2729dcf5f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:54.546350 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610143b8-7640-4550-895d-d6c2729dcf5f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:54.556366 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610143b8-7640-4550-895d-d6c2729dcf5f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:54.558415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610143b8-7640-4550-895d-d6c2729dcf5f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:54.562724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ce477-0ab8-4242-b750-c185d347b8de None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:54.576115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-610143b8-7640-4550-895d-d6c2729dcf5f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 09:47:54.576115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:54.576115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:54.576115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:54.576115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:54.576115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:54.576115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:54.576115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:54.576115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:54.576115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:54.576115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:54.576115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:54.576115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:47:54.576115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:47:54.576115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:47:54.576115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:54.577112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:54.578077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:54.578077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:54.578077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:47:54.578077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:47:54.578077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:47:54.578077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:47:54.578077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:47:54.578077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:47:54.578077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 09:47:54.578077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:54.578077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 328/657] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:54.578681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610143b8-7640-4550-895d-d6c2729dcf5f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:54.600952 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc6504-7cb0-4fc1-9e03-f6e950e292f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:54.602260 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc6504-7cb0-4fc1-9e03-f6e950e292f6 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:54.602748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc6504-7cb0-4fc1-9e03-f6e950e292f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:54.603257 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc6504-7cb0-4fc1-9e03-f6e950e292f6 None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:54.604289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc6504-7cb0-4fc1-9e03-f6e950e292f6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:54.604795 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc6504-7cb0-4fc1-9e03-f6e950e292f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:54.606455 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc6504-7cb0-4fc1-9e03-f6e950e292f6 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:54.627319 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 330/658] 10.222.0.55 () {56 vars in 1139 bytes} [Tue May 3 09:47:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:54.628547 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc6504-7cb0-4fc1-9e03-f6e950e292f6 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:54.702643 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610143b8-7640-4550-895d-d6c2729dcf5f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:54.733377 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc6504-7cb0-4fc1-9e03-f6e950e292f6 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:54.737194 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f855a-9d3c-40b8-bed7-93895a9f4eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:54.738028 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f855a-9d3c-40b8-bed7-93895a9f4eda None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:54.738307 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f855a-9d3c-40b8-bed7-93895a9f4eda None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:54.738871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f855a-9d3c-40b8-bed7-93895a9f4eda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:54.749909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f855a-9d3c-40b8-bed7-93895a9f4eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:54.751379 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f855a-9d3c-40b8-bed7-93895a9f4eda None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:54.769773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-285f855a-9d3c-40b8-bed7-93895a9f4eda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:54.769773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:54.769773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:54.769773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:54.769773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:54.769773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:54.769773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:54.769773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:54.769773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:54.769773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:54.769773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:54.769773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:54.769773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:54.769773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:54.769773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:54.770792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:54.770792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:54.770792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:54.770792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:54.770792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:54.770792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:54.770792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:54.770792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:54.770792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:54.770792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:54.770792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:54.770792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:54.770792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:54.770792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:54.770792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:54.770792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:54.770792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:54.771687 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:54.771687 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:54.771687 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:54.771687 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:54.771687 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 329/659] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:54.773361 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f855a-9d3c-40b8-bed7-93895a9f4eda None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:54.778120 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cf472-6ce5-4634-bac8-2eaabd886e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:54.779162 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cf472-6ce5-4634-bac8-2eaabd886e89 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:54.779648 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cf472-6ce5-4634-bac8-2eaabd886e89 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:54.780130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cf472-6ce5-4634-bac8-2eaabd886e89 None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:54.781196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cf472-6ce5-4634-bac8-2eaabd886e89 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:54.781748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cf472-6ce5-4634-bac8-2eaabd886e89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:54.784218 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cf472-6ce5-4634-bac8-2eaabd886e89 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:54.811205 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 331/660] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 3 09:47:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:54.812419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cf472-6ce5-4634-bac8-2eaabd886e89 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:54.876927 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f855a-9d3c-40b8-bed7-93895a9f4eda None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:54.909757 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b285b-7db7-4661-b2c4-7d8ee6c6ff72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:54.910248 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b285b-7db7-4661-b2c4-7d8ee6c6ff72 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:54.910576 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b285b-7db7-4661-b2c4-7d8ee6c6ff72 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:54.910853 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b285b-7db7-4661-b2c4-7d8ee6c6ff72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:54.931942 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cf472-6ce5-4634-bac8-2eaabd886e89 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:54.977537 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b285b-7db7-4661-b2c4-7d8ee6c6ff72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:54.979035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b285b-7db7-4661-b2c4-7d8ee6c6ff72 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:54.980844 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79576269-a938-4d00-81fa-763474d740fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:54.982260 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79576269-a938-4d00-81fa-763474d740fd None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:54.982537 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79576269-a938-4d00-81fa-763474d740fd None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:54.982808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79576269-a938-4d00-81fa-763474d740fd None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:54.983582 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79576269-a938-4d00-81fa-763474d740fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:54.983834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79576269-a938-4d00-81fa-763474d740fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:54.985196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79576269-a938-4d00-81fa-763474d740fd None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:55.000684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 332/661] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:55.000684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79576269-a938-4d00-81fa-763474d740fd None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:55.074851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 330/662] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:55.076573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2826ad3-0c3e-4232-908a-b2e423a1b8e0 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:55.076915 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2826ad3-0c3e-4232-908a-b2e423a1b8e0 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:55.077256 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2826ad3-0c3e-4232-908a-b2e423a1b8e0 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:55.078771 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 331/663] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:55.079410 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2826ad3-0c3e-4232-908a-b2e423a1b8e0 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:55.104197 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79576269-a938-4d00-81fa-763474d740fd None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:55.136119 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccca5e-586e-4b81-b6a6-f0a14f966162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:55.136865 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccca5e-586e-4b81-b6a6-f0a14f966162 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:55.137149 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccca5e-586e-4b81-b6a6-f0a14f966162 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:55.137428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccca5e-586e-4b81-b6a6-f0a14f966162 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:55.175350 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2826ad3-0c3e-4232-908a-b2e423a1b8e0 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:55.201358 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccca5e-586e-4b81-b6a6-f0a14f966162 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:55.202860 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccca5e-586e-4b81-b6a6-f0a14f966162 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:55.207415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886eb8bb-9f3c-45fa-921f-dc85713f564a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:55.208435 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb8bb-9f3c-45fa-921f-dc85713f564a None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:55.208888 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb8bb-9f3c-45fa-921f-dc85713f564a None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:55.209329 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb8bb-9f3c-45fa-921f-dc85713f564a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:55.216466 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886eb8bb-9f3c-45fa-921f-dc85713f564a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:55.217935 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886eb8bb-9f3c-45fa-921f-dc85713f564a None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:55.231754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-886eb8bb-9f3c-45fa-921f-dc85713f564a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:55.231754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:55.231754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:55.231754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:55.231754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:55.231754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:55.231754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:55.231754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:55.231754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:55.231754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:55.231754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:55.231754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:55.231754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:47:55.231754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:47:55.231754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:47:55.232647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:47:55.232647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:55.232647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:55.232647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:55.232647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:55.232647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:55.232647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:55.232647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:55.232647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:55.232647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:55.232647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:55.232647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:55.232647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:55.232647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:55.232647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:55.232647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:55.232647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:55.233636 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:47:55.233636 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:47:55.233636 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:47:55.233636 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:47:55.233636 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:47:55.233636 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:47:55.233636 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:55.233636 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:55.233636 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 332/664] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:55.234160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886eb8bb-9f3c-45fa-921f-dc85713f564a None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:55.310115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 333/665] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:55.311491 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb605f-c2bd-426d-85c7-bf33282d3fdc None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:55.311782 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb605f-c2bd-426d-85c7-bf33282d3fdc None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:55.312061 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb605f-c2bd-426d-85c7-bf33282d3fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:55.328107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-82cb605f-c2bd-426d-85c7-bf33282d3fdc None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:55.329343 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-82cb605f-c2bd-426d-85c7-bf33282d3fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:55.341642 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886eb8bb-9f3c-45fa-921f-dc85713f564a None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:55.373973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec4f61-d0f3-41e9-b8fa-f836b07f78b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:55.374769 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec4f61-d0f3-41e9-b8fa-f836b07f78b5 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:55.375045 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec4f61-d0f3-41e9-b8fa-f836b07f78b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:55.375325 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec4f61-d0f3-41e9-b8fa-f836b07f78b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:55.385987 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec4f61-d0f3-41e9-b8fa-f836b07f78b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:55.387448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec4f61-d0f3-41e9-b8fa-f836b07f78b5 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:55.397887 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 334/666] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:55.397887 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb605f-c2bd-426d-85c7-bf33282d3fdc None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:55.404720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-a6ec4f61-d0f3-41e9-b8fa-f836b07f78b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:55.404720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:55.404720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:55.404720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:55.404720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:55.404720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:55.404720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:55.404720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:55.404720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:55.404720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:55.404720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:55.404720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:55.404720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:55.404720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:55.404720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:55.405619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:55.405619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:55.405619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:55.405619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:55.405619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:55.405619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:55.405619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:55.405619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:55.405619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:55.405619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:55.405619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:55.405619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:55.405619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:55.405619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:55.405619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:55.405619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:55.405619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:55.406728 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:55.406728 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:55.406728 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:55.406728 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:55.406728 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 333/667] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:55.407080 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec4f61-d0f3-41e9-b8fa-f836b07f78b5 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:55.500653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb605f-c2bd-426d-85c7-bf33282d3fdc None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:55.509212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec4f61-d0f3-41e9-b8fa-f836b07f78b5 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:55.533366 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda864a-17d2-46af-b7e0-606d500c2201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:55.534058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda864a-17d2-46af-b7e0-606d500c2201 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:55.534340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda864a-17d2-46af-b7e0-606d500c2201 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:55.534609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda864a-17d2-46af-b7e0-606d500c2201 None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:55.535393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda864a-17d2-46af-b7e0-606d500c2201 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:55.535696 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda864a-17d2-46af-b7e0-606d500c2201 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:55.537128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda864a-17d2-46af-b7e0-606d500c2201 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:55.542348 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351714f-3b75-4201-8ec9-e78efed2ac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:55.543140 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351714f-3b75-4201-8ec9-e78efed2ac89 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:55.543422 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351714f-3b75-4201-8ec9-e78efed2ac89 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:55.543694 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351714f-3b75-4201-8ec9-e78efed2ac89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:55.553898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 335/668] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:47:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:55.553898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda864a-17d2-46af-b7e0-606d500c2201 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:55.555367 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351714f-3b75-4201-8ec9-e78efed2ac89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:55.556823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351714f-3b75-4201-8ec9-e78efed2ac89 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:55.573461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-0351714f-3b75-4201-8ec9-e78efed2ac89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:55.573461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:55.573461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:55.573461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:55.573461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:55.573461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:55.573461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:55.573461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:55.573461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:55.573461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:55.573461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:55.573461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:55.573461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:55.573461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:55.573461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:55.574389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:55.574389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:55.574389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:55.574389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:55.574389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:55.574389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:55.574389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:55.574389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:55.574389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:55.574389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:55.574389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:55.574389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:55.574389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:55.574389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:55.574389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:55.574389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:55.574389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:55.575377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:55.575377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:55.575377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:55.575377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:55.575377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 334/669] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:55.575658 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351714f-3b75-4201-8ec9-e78efed2ac89 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:55.652508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda864a-17d2-46af-b7e0-606d500c2201 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:55.680658 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351714f-3b75-4201-8ec9-e78efed2ac89 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:55.685708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687c3c4-c7b3-4453-8637-fce13a9316b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:55.686428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687c3c4-c7b3-4453-8637-fce13a9316b0 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:55.686711 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687c3c4-c7b3-4453-8637-fce13a9316b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:55.687032 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687c3c4-c7b3-4453-8637-fce13a9316b0 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:55.687741 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687c3c4-c7b3-4453-8637-fce13a9316b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:55.688082 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687c3c4-c7b3-4453-8637-fce13a9316b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:55.689421 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687c3c4-c7b3-4453-8637-fce13a9316b0 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:55.705926 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 336/670] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:55.705926 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687c3c4-c7b3-4453-8637-fce13a9316b0 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:55.712715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b4dac-1aec-4e0b-8518-990f96d6204c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:55.713511 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b4dac-1aec-4e0b-8518-990f96d6204c None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:55.713814 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b4dac-1aec-4e0b-8518-990f96d6204c None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:55.714076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b4dac-1aec-4e0b-8518-990f96d6204c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:55.724360 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b4dac-1aec-4e0b-8518-990f96d6204c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:55.731894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-8f9b4dac-1aec-4e0b-8518-990f96d6204c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:47:55.731894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:55.731894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:55.731894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:55.731894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:55.731894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:55.731894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:55.731894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:55.731894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:55.731894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:55.731894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:55.731894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:55.731894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:55.731894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:55.731894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:55.731894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:55.732836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:55.732836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:55.732836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:55.732836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:55.732836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:55.732836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:55.732836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:55.732836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:55.732836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:55.732836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:55.732836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:55.732836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:55.732836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:55.732836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:55.732836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:55.732836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:55.733715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:55.733715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:55.733715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:55.733715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:55.733715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:55.733715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:55.733715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:55.733715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:55.733715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:55.733715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:55.733715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:47:55.733715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:55.738686 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 335/671] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:47:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:55.739554 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b4dac-1aec-4e0b-8518-990f96d6204c None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:55.809893 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687c3c4-c7b3-4453-8637-fce13a9316b0 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:55.836560 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b4dac-1aec-4e0b-8518-990f96d6204c None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:55.841158 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db01a55-9ba0-4a8d-98f3-5f2a35874ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:55.841824 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db01a55-9ba0-4a8d-98f3-5f2a35874ab5 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:55.842110 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db01a55-9ba0-4a8d-98f3-5f2a35874ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:55.842382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db01a55-9ba0-4a8d-98f3-5f2a35874ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:55.843202 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db01a55-9ba0-4a8d-98f3-5f2a35874ab5 None admin] RBAC: Adding query filter params (role.id=779b01e1e2534bfba9971e7000b7c628, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=d5b508ac957b4224912fbc2c2f1ea324) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:55.843505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db01a55-9ba0-4a8d-98f3-5f2a35874ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:55.844916 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db01a55-9ba0-4a8d-98f3-5f2a35874ab5 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:55.850445 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 337/672] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:47:55 2022] GET /identity/v3/role_assignments?user.id=d5b508ac957b4224912fbc2c2f1ea324&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=779b01e1e2534bfba9971e7000b7c628 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:55.851226 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db01a55-9ba0-4a8d-98f3-5f2a35874ab5 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:55.870209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a8d0a-1103-4059-a705-7784adf5c24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:55.870890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a8d0a-1103-4059-a705-7784adf5c24f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:55.871165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a8d0a-1103-4059-a705-7784adf5c24f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:55.871432 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a8d0a-1103-4059-a705-7784adf5c24f None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:55.872165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a8d0a-1103-4059-a705-7784adf5c24f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:55.873024 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a8d0a-1103-4059-a705-7784adf5c24f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:55.874777 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a8d0a-1103-4059-a705-7784adf5c24f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:55.888590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 336/673] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:55.889465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a8d0a-1103-4059-a705-7784adf5c24f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:55.960286 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db01a55-9ba0-4a8d-98f3-5f2a35874ab5 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:56.007171 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a8d0a-1103-4059-a705-7784adf5c24f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:56.010688 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46829d61-43e9-4002-ac07-9ccf99442f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:56.011522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46829d61-43e9-4002-ac07-9ccf99442f4e None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:56.011761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46829d61-43e9-4002-ac07-9ccf99442f4e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:56.012028 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46829d61-43e9-4002-ac07-9ccf99442f4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:56.019359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46829d61-43e9-4002-ac07-9ccf99442f4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:56.020835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46829d61-43e9-4002-ac07-9ccf99442f4e None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:56.035701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-46829d61-43e9-4002-ac07-9ccf99442f4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:56.035701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:56.035701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:56.035701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:56.035701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:56.035701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:56.035701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:56.035701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:56.035701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:56.035701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:56.035701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:56.035701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:56.035701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:47:56.035701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:47:56.035701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:47:56.036661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:47:56.036661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:56.036661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:56.036661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:56.036661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:56.036661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:56.036661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:56.036661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:56.036661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:56.036661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:56.036661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:56.036661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:56.036661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:56.036661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:56.036661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:56.036661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:56.036661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:56.038232 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:47:56.038232 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:47:56.038232 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:47:56.038232 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:47:56.038232 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:47:56.038232 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:47:56.038232 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:56.038232 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:56.038232 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 338/674] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:56.040405 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e000d3c-f0d2-4b91-a1a5-10d616a5909c None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:56.040405 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e000d3c-f0d2-4b91-a1a5-10d616a5909c None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:56.040571 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e000d3c-f0d2-4b91-a1a5-10d616a5909c None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:56.041894 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 339/675] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:56.042460 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e000d3c-f0d2-4b91-a1a5-10d616a5909c None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:56.059335 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d785a-8888-4006-82ef-b7ff2bb9ecd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:56.060070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d785a-8888-4006-82ef-b7ff2bb9ecd9 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:56.060296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d785a-8888-4006-82ef-b7ff2bb9ecd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:56.061557 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d785a-8888-4006-82ef-b7ff2bb9ecd9 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:56.061738 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d785a-8888-4006-82ef-b7ff2bb9ecd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:56.062081 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d785a-8888-4006-82ef-b7ff2bb9ecd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:56.063457 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d785a-8888-4006-82ef-b7ff2bb9ecd9 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:56.073585 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 337/676] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:47:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:56.074449 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d785a-8888-4006-82ef-b7ff2bb9ecd9 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:56.155975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e000d3c-f0d2-4b91-a1a5-10d616a5909c None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:56.184289 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d785a-8888-4006-82ef-b7ff2bb9ecd9 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:56.189096 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b3919-7fa4-4b42-8724-236edae27af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:56.189929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b3919-7fa4-4b42-8724-236edae27af4 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:56.190209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b3919-7fa4-4b42-8724-236edae27af4 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:56.190478 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b3919-7fa4-4b42-8724-236edae27af4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:56.197234 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b3919-7fa4-4b42-8724-236edae27af4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:56.198702 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b3919-7fa4-4b42-8724-236edae27af4 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:56.212806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-f12b3919-7fa4-4b42-8724-236edae27af4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:56.212806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:56.212806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:56.212806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:56.212806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:56.212806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:56.212806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:56.212806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:56.212806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:56.212806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:56.212806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:56.212806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:56.212806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:47:56.212806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:47:56.212806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:47:56.213708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:47:56.213708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:56.213708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:56.213708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:56.213708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:56.213708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:56.213708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:56.213708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:56.213708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:56.213708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:56.213708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:56.213708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:56.213708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:56.213708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:56.213708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:56.213708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:56.213708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:56.214631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:47:56.214631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:47:56.214631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:47:56.214631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:47:56.214631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:47:56.214631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:47:56.214631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:56.214631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:56.214631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 340/677] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:56.215563 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2966-6d1f-45a6-8d20-1db70581a784 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:56.215563 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2966-6d1f-45a6-8d20-1db70581a784 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:56.215713 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2966-6d1f-45a6-8d20-1db70581a784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:56.225029 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b763a4-94bf-430b-b0c4-cb23098cbdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:56.225694 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b763a4-94bf-430b-b0c4-cb23098cbdce None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:56.226005 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b763a4-94bf-430b-b0c4-cb23098cbdce None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:56.226604 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b763a4-94bf-430b-b0c4-cb23098cbdce None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:56.228279 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b763a4-94bf-430b-b0c4-cb23098cbdce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:56.228597 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b763a4-94bf-430b-b0c4-cb23098cbdce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:56.230483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b763a4-94bf-430b-b0c4-cb23098cbdce None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:56.233488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-9b7b2966-6d1f-45a6-8d20-1db70581a784 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:56.234677 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-9b7b2966-6d1f-45a6-8d20-1db70581a784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:56.246545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 338/678] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:47:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:56.247724 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b763a4-94bf-430b-b0c4-cb23098cbdce None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:56.313429 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 341/679] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:56.314323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2966-6d1f-45a6-8d20-1db70581a784 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:56.362581 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b763a4-94bf-430b-b0c4-cb23098cbdce None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:56.395883 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130318f-a16d-4c67-b113-de4c2117a440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:56.396673 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130318f-a16d-4c67-b113-de4c2117a440 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:56.396950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130318f-a16d-4c67-b113-de4c2117a440 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:56.397219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130318f-a16d-4c67-b113-de4c2117a440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:56.407091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130318f-a16d-4c67-b113-de4c2117a440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:56.408523 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130318f-a16d-4c67-b113-de4c2117a440 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:56.411051 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2966-6d1f-45a6-8d20-1db70581a784 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:56.425573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-9130318f-a16d-4c67-b113-de4c2117a440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:56.425573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:56.425573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:56.425573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:56.425573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:56.425573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:56.425573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:56.425573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:56.425573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:56.425573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:56.425573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:56.425573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:56.425573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:56.425573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:56.425573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:56.426610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:56.426610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:56.426610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:56.426610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:56.426610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:56.426610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:56.426610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:56.426610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:56.426610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:56.426610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:56.426610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:56.426610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:56.426610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:56.426610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:56.426610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:56.426610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:56.426610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:56.427494 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:56.427494 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:56.427494 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:56.427494 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:56.427494 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 339/680] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:56.427838 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130318f-a16d-4c67-b113-de4c2117a440 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:56.446333 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d2925-4434-42b5-8c89-814035523ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:56.447220 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d2925-4434-42b5-8c89-814035523ccb None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:56.447632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d2925-4434-42b5-8c89-814035523ccb None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:56.448047 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d2925-4434-42b5-8c89-814035523ccb None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:56.448827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d2925-4434-42b5-8c89-814035523ccb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:56.449132 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d2925-4434-42b5-8c89-814035523ccb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:56.450578 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d2925-4434-42b5-8c89-814035523ccb None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:56.466598 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 342/681] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:47:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:56.467753 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d2925-4434-42b5-8c89-814035523ccb None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:56.525958 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130318f-a16d-4c67-b113-de4c2117a440 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:56.558489 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d267e48-5542-4f5f-b28f-fa0b3ef6ffb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:56.559140 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d267e48-5542-4f5f-b28f-fa0b3ef6ffb7 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:56.559418 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d267e48-5542-4f5f-b28f-fa0b3ef6ffb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:56.559687 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d267e48-5542-4f5f-b28f-fa0b3ef6ffb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:56.560512 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d267e48-5542-4f5f-b28f-fa0b3ef6ffb7 None admin] RBAC: Adding query filter params (role.id=779b01e1e2534bfba9971e7000b7c628, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=7eb3d5bb36f445cabb62cacf1b34984d) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:56.560820 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d267e48-5542-4f5f-b28f-fa0b3ef6ffb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:56.562270 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d267e48-5542-4f5f-b28f-fa0b3ef6ffb7 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:56.563511 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d2925-4434-42b5-8c89-814035523ccb None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:56.568081 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 340/682] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:47:56 2022] GET /identity/v3/role_assignments?user.id=7eb3d5bb36f445cabb62cacf1b34984d&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=779b01e1e2534bfba9971e7000b7c628 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:56.568867 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d267e48-5542-4f5f-b28f-fa0b3ef6ffb7 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:56.598606 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5333b-ec3b-4808-866c-bf3942a9f6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:56.599678 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5333b-ec3b-4808-866c-bf3942a9f6f3 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:56.600109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5333b-ec3b-4808-866c-bf3942a9f6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:56.600535 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5333b-ec3b-4808-866c-bf3942a9f6f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:56.612948 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5333b-ec3b-4808-866c-bf3942a9f6f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:47:56.621081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-3cb5333b-ec3b-4808-866c-bf3942a9f6f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:56.621081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:56.621081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:56.621081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:56.621081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:56.621081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:56.621081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:56.621081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:56.621081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:56.621081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:56.621081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:56.621081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:56.621081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:47:56.621081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:47:56.621081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:47:56.621081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:47:56.622287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:47:56.622287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:47:56.622287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:47:56.622287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:47:56.622287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:56.622287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:56.622287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:56.622287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:56.622287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:56.622287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:56.622287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:56.622287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:56.622287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:56.622287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:56.622287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:56.622287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:56.623261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:56.623261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:56.623261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:56.623261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:56.623261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:47:56.623261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:47:56.623261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:47:56.623261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:47:56.623261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:47:56.623261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:47:56.623261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:47:56.623261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:56.625550 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 343/683] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:47:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:56.626733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5333b-ec3b-4808-866c-bf3942a9f6f3 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:56.709254 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d267e48-5542-4f5f-b28f-fa0b3ef6ffb7 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:56.732039 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5333b-ec3b-4808-866c-bf3942a9f6f3 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:56.753631 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53733ac-1132-44e6-8ccf-364b8197071c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:56.754399 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53733ac-1132-44e6-8ccf-364b8197071c None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:56.754674 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53733ac-1132-44e6-8ccf-364b8197071c None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:56.754961 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53733ac-1132-44e6-8ccf-364b8197071c None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:56.755707 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53733ac-1132-44e6-8ccf-364b8197071c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:56.756007 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53733ac-1132-44e6-8ccf-364b8197071c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:56.757418 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53733ac-1132-44e6-8ccf-364b8197071c None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:56.769735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 341/684] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:56.770679 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53733ac-1132-44e6-8ccf-364b8197071c None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:56.784303 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e9ce1-faa4-4652-bc6a-5e29962fea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:56.785252 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e9ce1-faa4-4652-bc6a-5e29962fea4a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:56.785530 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e9ce1-faa4-4652-bc6a-5e29962fea4a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:56.785846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e9ce1-faa4-4652-bc6a-5e29962fea4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:56.786692 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e9ce1-faa4-4652-bc6a-5e29962fea4a None admin] RBAC: Adding query filter params (role.id=779b01e1e2534bfba9971e7000b7c628, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=f361b5ebd2b246c4bed5be82a70f63e9) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:56.787159 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e9ce1-faa4-4652-bc6a-5e29962fea4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:56.788632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e9ce1-faa4-4652-bc6a-5e29962fea4a None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:56.795264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 344/685] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:47:56 2022] GET /identity/v3/role_assignments?user.id=f361b5ebd2b246c4bed5be82a70f63e9&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=779b01e1e2534bfba9971e7000b7c628 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:56.802738 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e9ce1-faa4-4652-bc6a-5e29962fea4a None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:56.910361 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53733ac-1132-44e6-8ccf-364b8197071c None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:56.947272 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a0590-999f-40f8-89d4-a4b99bd9ed7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:56.948162 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a0590-999f-40f8-89d4-a4b99bd9ed7f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:56.948535 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a0590-999f-40f8-89d4-a4b99bd9ed7f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:56.948741 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e9ce1-faa4-4652-bc6a-5e29962fea4a None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:56.948985 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a0590-999f-40f8-89d4-a4b99bd9ed7f None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:56.949867 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a0590-999f-40f8-89d4-a4b99bd9ed7f None admin] RBAC: Adding query filter params (name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:56.950266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a0590-999f-40f8-89d4-a4b99bd9ed7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:56.952423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a0590-999f-40f8-89d4-a4b99bd9ed7f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:56.960693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 342/686] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:47:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:56.966749 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a0590-999f-40f8-89d4-a4b99bd9ed7f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:56.991892 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a323a4e-1be6-4d37-a824-556fa638900f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:56.993410 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a323a4e-1be6-4d37-a824-556fa638900f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:56.994037 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a323a4e-1be6-4d37-a824-556fa638900f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:56.994484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a323a4e-1be6-4d37-a824-556fa638900f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:57.006028 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a323a4e-1be6-4d37-a824-556fa638900f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:57.007839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a323a4e-1be6-4d37-a824-556fa638900f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:57.026723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-8a323a4e-1be6-4d37-a824-556fa638900f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 09:47:57.026723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:57.026723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:57.026723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:57.026723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:57.026723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:57.026723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:57.026723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:57.026723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:57.026723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:57.026723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:57.026723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:57.026723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:47:57.026723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:47:57.026723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:47:57.026723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:57.027935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:57.029140 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:57.029140 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:57.029140 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:47:57.029140 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:47:57.029140 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:47:57.029140 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:47:57.029140 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:47:57.029140 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:47:57.029140 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 09:47:57.029140 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:57.032295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 345/687] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 3 09:47:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:57.040033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a323a4e-1be6-4d37-a824-556fa638900f None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:57.077474 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a0590-999f-40f8-89d4-a4b99bd9ed7f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:57.111234 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cb231-0251-4c50-a774-086848568ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:57.112223 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cb231-0251-4c50-a774-086848568ad8 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:57.112551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cb231-0251-4c50-a774-086848568ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:57.112914 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cb231-0251-4c50-a774-086848568ad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:57.124246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cb231-0251-4c50-a774-086848568ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:57.126193 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cb231-0251-4c50-a774-086848568ad8 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:57.145821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-f02cb231-0251-4c50-a774-086848568ad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:57.145821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:57.145821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:57.145821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:57.145821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:57.145821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:57.145821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:57.145821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:57.145821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:57.145821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:57.145821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:57.145821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:57.145821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:57.145821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:57.145821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:57.146966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:57.146966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:57.146966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:57.146966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:57.146966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:57.146966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:57.146966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:57.146966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:57.146966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:57.146966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:57.146966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:57.146966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:57.146966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:57.146966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:57.146966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:57.146966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:57.146966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:57.148220 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:57.148220 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:57.148220 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:57.148220 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:57.148966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 343/688] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:57.154456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cb231-0251-4c50-a774-086848568ad8 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:57.164630 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a323a4e-1be6-4d37-a824-556fa638900f None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:57.199359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4860a-daa4-4f45-ab54-bfcd4eba00ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:57.200696 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4860a-daa4-4f45-ab54-bfcd4eba00ef None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:57.201144 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4860a-daa4-4f45-ab54-bfcd4eba00ef None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:57.201604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4860a-daa4-4f45-ab54-bfcd4eba00ef None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:57.202647 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4860a-daa4-4f45-ab54-bfcd4eba00ef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:57.203142 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4860a-daa4-4f45-ab54-bfcd4eba00ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:57.204729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4860a-daa4-4f45-ab54-bfcd4eba00ef None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:57.223017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 346/689] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 3 09:47:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:57.228687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4860a-daa4-4f45-ab54-bfcd4eba00ef None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:57.261581 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cb231-0251-4c50-a774-086848568ad8 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:57.297614 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dada9c-8bdf-4946-a91d-9bc41612a8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:57.298453 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dada9c-8bdf-4946-a91d-9bc41612a8fb None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:57.298795 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dada9c-8bdf-4946-a91d-9bc41612a8fb None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:57.299133 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dada9c-8bdf-4946-a91d-9bc41612a8fb None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:57.299921 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dada9c-8bdf-4946-a91d-9bc41612a8fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:57.300365 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dada9c-8bdf-4946-a91d-9bc41612a8fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:57.301860 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dada9c-8bdf-4946-a91d-9bc41612a8fb None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:57.323928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 344/690] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:57.329738 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dada9c-8bdf-4946-a91d-9bc41612a8fb None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:57.331616 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4860a-daa4-4f45-ab54-bfcd4eba00ef None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:57.365703 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f47bbe-f5e0-4883-9b45-0b982a2df09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:57.367088 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f47bbe-f5e0-4883-9b45-0b982a2df09d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:57.367542 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f47bbe-f5e0-4883-9b45-0b982a2df09d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:57.367980 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f47bbe-f5e0-4883-9b45-0b982a2df09d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:57.430927 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dada9c-8bdf-4946-a91d-9bc41612a8fb None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:57.444582 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f47bbe-f5e0-4883-9b45-0b982a2df09d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:57.446559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f47bbe-f5e0-4883-9b45-0b982a2df09d None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:57.465664 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dc9fd-5479-4e2d-b59d-8dab8e9900f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:57.466531 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dc9fd-5479-4e2d-b59d-8dab8e9900f7 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:57.466813 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dc9fd-5479-4e2d-b59d-8dab8e9900f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:57.467082 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dc9fd-5479-4e2d-b59d-8dab8e9900f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:57.474664 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dc9fd-5479-4e2d-b59d-8dab8e9900f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:57.476241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dc9fd-5479-4e2d-b59d-8dab8e9900f7 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:57.491507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-438dc9fd-5479-4e2d-b59d-8dab8e9900f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 09:47:57.491507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:57.491507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:57.491507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:57.491507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:57.491507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:57.491507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:57.491507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:57.491507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:57.491507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:57.491507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:57.491507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:57.491507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:47:57.491507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:47:57.491507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:47:57.491507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:57.492744 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:57.493784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:57.493784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:57.493784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:47:57.493784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:47:57.493784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:47:57.493784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:47:57.493784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:47:57.493784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:47:57.493784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 09:47:57.493784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:57.493784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 345/691] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:47:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:57.499017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dc9fd-5479-4e2d-b59d-8dab8e9900f7 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:57.561827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 347/692] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 09:47:57.566868 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f47bbe-f5e0-4883-9b45-0b982a2df09d None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:57.647995 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dc9fd-5479-4e2d-b59d-8dab8e9900f7 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:57.710023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a3e1f-430d-461b-a84d-9497ac13c53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:57.710638 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a3e1f-430d-461b-a84d-9497ac13c53a None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:57.710913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a3e1f-430d-461b-a84d-9497ac13c53a None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:57.711179 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a3e1f-430d-461b-a84d-9497ac13c53a None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:57.712010 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a3e1f-430d-461b-a84d-9497ac13c53a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:57.712312 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a3e1f-430d-461b-a84d-9497ac13c53a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:57.713728 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a3e1f-430d-461b-a84d-9497ac13c53a None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:57.726188 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f47bbe-f5e0-4883-9b45-0b982a2df09d None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:57.748482 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 346/693] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 3 09:47:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:57.755360 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a3e1f-430d-461b-a84d-9497ac13c53a None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:57.784622 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dabf2e-cae7-4979-a13f-c30ec80507d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:57.785415 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dabf2e-cae7-4979-a13f-c30ec80507d2 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:57.785684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dabf2e-cae7-4979-a13f-c30ec80507d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:57.785968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dabf2e-cae7-4979-a13f-c30ec80507d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:57.803972 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dabf2e-cae7-4979-a13f-c30ec80507d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:57.806451 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dabf2e-cae7-4979-a13f-c30ec80507d2 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:57.832843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-21dabf2e-cae7-4979-a13f-c30ec80507d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:57.832843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:57.832843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:57.832843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:57.832843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:57.832843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:57.832843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:57.832843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:57.832843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:57.832843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:57.832843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:57.832843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:57.832843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:57.832843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:57.832843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:57.833808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:57.833808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:57.833808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:57.833808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:57.833808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:57.833808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:57.833808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:57.833808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:57.833808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:57.833808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:57.833808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:57.833808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:57.833808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:57.833808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:57.833808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:57.833808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:57.833808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:57.834717 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:57.834717 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:57.834717 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:57.834717 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:57.837247 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 348/694] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:57.846807 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dabf2e-cae7-4979-a13f-c30ec80507d2 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:57.887162 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a3e1f-430d-461b-a84d-9497ac13c53a None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:57.945437 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b1a3a-309b-46bc-baac-e972eb042c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:57.946141 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b1a3a-309b-46bc-baac-e972eb042c39 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:57.946416 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b1a3a-309b-46bc-baac-e972eb042c39 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:57.946684 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b1a3a-309b-46bc-baac-e972eb042c39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:58.017754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b1a3a-309b-46bc-baac-e972eb042c39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:58.019175 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b1a3a-309b-46bc-baac-e972eb042c39 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:58.091697 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dabf2e-cae7-4979-a13f-c30ec80507d2 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:58.129966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 347/695] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:47:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 09:47:58.138185 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b1a3a-309b-46bc-baac-e972eb042c39 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:58.183419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be6eb7-fda8-4e20-a461-ce6d77164587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:58.184091 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be6eb7-fda8-4e20-a461-ce6d77164587 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:58.184364 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be6eb7-fda8-4e20-a461-ce6d77164587 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:58.184630 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be6eb7-fda8-4e20-a461-ce6d77164587 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:58.185357 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be6eb7-fda8-4e20-a461-ce6d77164587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:58.185710 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be6eb7-fda8-4e20-a461-ce6d77164587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:58.187155 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be6eb7-fda8-4e20-a461-ce6d77164587 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:58.214982 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 349/696] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:58.220332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be6eb7-fda8-4e20-a461-ce6d77164587 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:58.242504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b1a3a-309b-46bc-baac-e972eb042c39 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:58.286034 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a20e39-145e-4204-af11-0d9358cc6057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:58.286034 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a20e39-145e-4204-af11-0d9358cc6057 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:58.286034 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a20e39-145e-4204-af11-0d9358cc6057 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:58.286034 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a20e39-145e-4204-af11-0d9358cc6057 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:58.300415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a20e39-145e-4204-af11-0d9358cc6057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:58.302112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a20e39-145e-4204-af11-0d9358cc6057 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:58.319979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-c5a20e39-145e-4204-af11-0d9358cc6057 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:58.319979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:58.319979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:58.319979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:58.319979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:58.319979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:58.319979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:58.319979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:58.319979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:58.319979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:58.319979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:58.319979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:58.319979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:58.319979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:58.319979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:58.321165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:58.321165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:58.321165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:58.321165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:58.321165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:58.321165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:58.321165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:58.321165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:58.321165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:58.321165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:58.321165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:58.321165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:58.321165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:58.321165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:58.321165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:58.321165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:58.321165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:58.322298 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:58.322298 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:58.322298 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:58.322298 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:58.324173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 348/697] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:58.325684 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a97d0-79ea-4650-9567-d712d1da75a3 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:58.326130 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a97d0-79ea-4650-9567-d712d1da75a3 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:58.326551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a97d0-79ea-4650-9567-d712d1da75a3 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:58.328242 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 349/698] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:58.329132 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a97d0-79ea-4650-9567-d712d1da75a3 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:58.331126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be6eb7-fda8-4e20-a461-ce6d77164587 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:58.364517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7864c6-298d-4834-bb9d-8db15f871c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:58.365451 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7864c6-298d-4834-bb9d-8db15f871c8f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:58.365946 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7864c6-298d-4834-bb9d-8db15f871c8f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:58.366316 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7864c6-298d-4834-bb9d-8db15f871c8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:58.373608 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7864c6-298d-4834-bb9d-8db15f871c8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:58.375305 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7864c6-298d-4834-bb9d-8db15f871c8f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:58.389594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-1c7864c6-298d-4834-bb9d-8db15f871c8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:58.389594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:58.389594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:58.389594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:58.389594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:58.389594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:58.389594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:58.389594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:58.389594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:58.389594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:58.389594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:58.389594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:58.389594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:47:58.389594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:47:58.389594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:47:58.390719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:47:58.390719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:58.390719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:58.390719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:58.390719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:58.390719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:58.390719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:58.390719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:58.390719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:58.390719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:58.390719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:58.390719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:58.390719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:58.390719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:58.390719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:58.390719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:58.390719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:58.391805 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:47:58.391805 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:47:58.391805 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:47:58.391805 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:47:58.391805 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:47:58.391805 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:47:58.391805 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:58.391805 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:58.398004 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 350/699] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:47:58.399444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dbcd9-1a94-4cda-a999-b68232ecf557 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:58.399822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dbcd9-1a94-4cda-a999-b68232ecf557 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:58.400187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dbcd9-1a94-4cda-a999-b68232ecf557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:58.416752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-858dbcd9-1a94-4cda-a999-b68232ecf557 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:58.418063 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-858dbcd9-1a94-4cda-a999-b68232ecf557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:58.432764 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a97d0-79ea-4650-9567-d712d1da75a3 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:58.466720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6e9b2-6cdb-4613-9156-7212161f7671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:58.467688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6e9b2-6cdb-4613-9156-7212161f7671 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:58.468135 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6e9b2-6cdb-4613-9156-7212161f7671 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:58.468595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6e9b2-6cdb-4613-9156-7212161f7671 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:58.469479 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6e9b2-6cdb-4613-9156-7212161f7671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:58.469991 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6e9b2-6cdb-4613-9156-7212161f7671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:58.471510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6e9b2-6cdb-4613-9156-7212161f7671 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:58.483798 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 350/700] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:58.485007 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6e9b2-6cdb-4613-9156-7212161f7671 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:58.485950 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 351/701] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:58.489499 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858dbcd9-1a94-4cda-a999-b68232ecf557 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:58.580584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6e9b2-6cdb-4613-9156-7212161f7671 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:58.586440 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858dbcd9-1a94-4cda-a999-b68232ecf557 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:58.613962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def3b47-e2a6-402d-b6ba-9320480ea19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:58.615001 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def3b47-e2a6-402d-b6ba-9320480ea19e None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:58.615481 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def3b47-e2a6-402d-b6ba-9320480ea19e None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:58.615942 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def3b47-e2a6-402d-b6ba-9320480ea19e None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:58.616952 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def3b47-e2a6-402d-b6ba-9320480ea19e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:58.617471 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def3b47-e2a6-402d-b6ba-9320480ea19e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:58.619229 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def3b47-e2a6-402d-b6ba-9320480ea19e None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:58.619885 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b90d7e-2814-4d6e-8a19-7273c99f06bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:58.620687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b90d7e-2814-4d6e-8a19-7273c99f06bc None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:58.620959 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b90d7e-2814-4d6e-8a19-7273c99f06bc None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:58.621223 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b90d7e-2814-4d6e-8a19-7273c99f06bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:58.628667 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b90d7e-2814-4d6e-8a19-7273c99f06bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:58.630820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b90d7e-2814-4d6e-8a19-7273c99f06bc None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:58.635241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 351/702] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:47:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:58.636431 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def3b47-e2a6-402d-b6ba-9320480ea19e None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:58.650752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-45b90d7e-2814-4d6e-8a19-7273c99f06bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:58.650752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:58.650752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:58.650752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:58.650752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:58.650752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:58.650752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:58.650752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:58.650752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:58.650752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:58.650752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:58.650752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:58.650752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:47:58.650752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:47:58.650752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:47:58.651687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:47:58.651687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:58.651687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:58.651687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:58.651687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:58.651687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:58.651687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:58.651687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:58.651687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:58.651687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:58.651687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:58.651687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:58.651687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:58.651687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:58.651687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:58.651687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:58.651687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:58.653209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:47:58.653209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:47:58.653209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:47:58.653209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:47:58.653209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:47:58.653209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:47:58.653209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:47:58.653209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:58.653209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 352/703] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:58.653209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b90d7e-2814-4d6e-8a19-7273c99f06bc None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:58.739173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def3b47-e2a6-402d-b6ba-9320480ea19e None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:58.751109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b90d7e-2814-4d6e-8a19-7273c99f06bc None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:58.773449 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284fb50-6658-4151-bd57-08009cfcd5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:58.775136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284fb50-6658-4151-bd57-08009cfcd5a2 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:58.775607 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284fb50-6658-4151-bd57-08009cfcd5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:58.776067 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284fb50-6658-4151-bd57-08009cfcd5a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:58.785647 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a54d16-4f4e-4e53-adba-9e809644a765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:58.786748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a54d16-4f4e-4e53-adba-9e809644a765 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:58.787159 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284fb50-6658-4151-bd57-08009cfcd5a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:58.787266 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a54d16-4f4e-4e53-adba-9e809644a765 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:58.787703 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a54d16-4f4e-4e53-adba-9e809644a765 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:58.789146 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284fb50-6658-4151-bd57-08009cfcd5a2 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:58.789273 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a54d16-4f4e-4e53-adba-9e809644a765 None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=efb008cfc6424998917da60d72689f55) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:58.789841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a54d16-4f4e-4e53-adba-9e809644a765 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:58.792699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a54d16-4f4e-4e53-adba-9e809644a765 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:58.806136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 353/704] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:47:58 2022] GET /identity/v3/role_assignments?user.id=efb008cfc6424998917da60d72689f55&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=52d3ad3e32c741938997691c9a909b81 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:58.807152 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a54d16-4f4e-4e53-adba-9e809644a765 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:58.808023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-7284fb50-6658-4151-bd57-08009cfcd5a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:58.808023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:58.808023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:58.808023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:58.808023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:58.808023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:58.808023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:58.808023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:58.808023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:58.808023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:58.808023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:58.808023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:58.808023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:47:58.808023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:47:58.808023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:47:58.808879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:47:58.808879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:58.808879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:58.808879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:58.808879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:58.808879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:58.808879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:58.808879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:58.808879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:47:58.808879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:58.808879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:58.808879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:58.808879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:58.808879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:58.808879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:58.808879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:58.808879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:58.809760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:47:58.809760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:47:58.809760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:47:58.809760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:47:58.812063 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 352/705] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:58.821858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284fb50-6658-4151-bd57-08009cfcd5a2 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:58.988098 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a54d16-4f4e-4e53-adba-9e809644a765 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:59.012010 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284fb50-6658-4151-bd57-08009cfcd5a2 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:59.036265 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a4796-2fcb-4f6a-a4ce-9198a4d7ce9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:59.036936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a4796-2fcb-4f6a-a4ce-9198a4d7ce9d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:59.037214 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a4796-2fcb-4f6a-a4ce-9198a4d7ce9d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:59.037485 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a4796-2fcb-4f6a-a4ce-9198a4d7ce9d None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:59.038334 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a4796-2fcb-4f6a-a4ce-9198a4d7ce9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:59.038691 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a4796-2fcb-4f6a-a4ce-9198a4d7ce9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:59.040203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a4796-2fcb-4f6a-a4ce-9198a4d7ce9d None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:59.053950 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 354/706] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:47:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:59.059854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a4796-2fcb-4f6a-a4ce-9198a4d7ce9d None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:59.061548 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db59bf-af50-47b3-906e-08e27aac8692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:59.062633 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db59bf-af50-47b3-906e-08e27aac8692 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:59.063118 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db59bf-af50-47b3-906e-08e27aac8692 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:59.064422 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db59bf-af50-47b3-906e-08e27aac8692 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:59.065427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db59bf-af50-47b3-906e-08e27aac8692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:59.065947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db59bf-af50-47b3-906e-08e27aac8692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:59.067536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db59bf-af50-47b3-906e-08e27aac8692 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:59.084057 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 353/707] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:59.090336 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db59bf-af50-47b3-906e-08e27aac8692 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:59.202913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db59bf-af50-47b3-906e-08e27aac8692 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:59.238810 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e3e0d-9e2d-4afb-bebc-27b1fdcc2d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:59.239939 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e3e0d-9e2d-4afb-bebc-27b1fdcc2d8f None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:59.240412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e3e0d-9e2d-4afb-bebc-27b1fdcc2d8f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:59.240927 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e3e0d-9e2d-4afb-bebc-27b1fdcc2d8f None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:59.241887 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e3e0d-9e2d-4afb-bebc-27b1fdcc2d8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:59.244095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e3e0d-9e2d-4afb-bebc-27b1fdcc2d8f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:59.252476 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a4796-2fcb-4f6a-a4ce-9198a4d7ce9d None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:59.276558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 354/708] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:47:59 2022] POST /identity/v3/users => generated 254 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:47:59.278739 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46e164-996f-4116-aef4-8437c6e2c78d None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:59.279224 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46e164-996f-4116-aef4-8437c6e2c78d None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:59.279728 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46e164-996f-4116-aef4-8437c6e2c78d None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:59.281590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 355/709] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:59.295273 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a9958-033e-4438-a48b-25f068bd2357 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:59.295814 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a9958-033e-4438-a48b-25f068bd2357 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:59.296340 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a9958-033e-4438-a48b-25f068bd2357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:59.316573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-657a9958-033e-4438-a48b-25f068bd2357 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:59.318375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-657a9958-033e-4438-a48b-25f068bd2357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:59.342910 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f8eba-1f31-48b4-b385-6e573bf284e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:59.343356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f8eba-1f31-48b4-b385-6e573bf284e4 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:59.343572 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f8eba-1f31-48b4-b385-6e573bf284e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:59.343843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f8eba-1f31-48b4-b385-6e573bf284e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:59.344678 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f8eba-1f31-48b4-b385-6e573bf284e4 None admin] RBAC: Adding query filter params (role.id=779b01e1e2534bfba9971e7000b7c628, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=73dfc1b485d647f1ae59a405c978599f) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:59.344982 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f8eba-1f31-48b4-b385-6e573bf284e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:59.346448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f8eba-1f31-48b4-b385-6e573bf284e4 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:59.360356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 355/710] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:47:59 2022] GET /identity/v3/role_assignments?user.id=73dfc1b485d647f1ae59a405c978599f&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=779b01e1e2534bfba9971e7000b7c628 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:47:59.399047 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 356/711] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:59.432811 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f8eba-1f31-48b4-b385-6e573bf284e4 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:59.576043 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f8eba-1f31-48b4-b385-6e573bf284e4 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:59.619818 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a974c1-3bc5-4d41-859c-d17614d5c376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:59.620664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a974c1-3bc5-4d41-859c-d17614d5c376 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:59.620938 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a974c1-3bc5-4d41-859c-d17614d5c376 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:59.621205 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a974c1-3bc5-4d41-859c-d17614d5c376 None admin] PATH_INFO: `/v3/services/network` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:59.621914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a974c1-3bc5-4d41-859c-d17614d5c376 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:59.623417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a974c1-3bc5-4d41-859c-d17614d5c376 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:59.638799 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-03a974c1-3bc5-4d41-859c-d17614d5c376 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 09:47:59.638799 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:59.638799 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:47:59.638799 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:47:59.638799 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:47:59.638799 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:47:59.638799 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:47:59.638799 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:47:59.638799 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 09:47:59.638799 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:59.638799 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:47:59.638799 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:59.638799 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:47:59.638799 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:47:59.638799 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:47:59.638799 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:47:59.638799 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:47:59.639906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:47:59.639906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:47:59.639906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:47:59.639906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:47:59.639906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:47:59.639906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:47:59.639906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:47:59.639906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:47:59.639906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:47:59.639906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:47:59.639906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:47:59.639906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:47:59.639906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:47:59.639906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:47:59.639906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:47:59.639906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:47:59.640742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:47:59.640742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:47:59.640742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:47:59.640742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:47:59.640742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:47:59.640742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:47:59.640742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:47:59.640742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:47:59.640742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:47:59.640742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:47:59.640742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:47:59.640742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:47:59.640742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 09:47:59.640742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:47:59.644930 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 356/712] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:47:59 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:47:59.646346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a9958-033e-4438-a48b-25f068bd2357 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:59.766653 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a9958-033e-4438-a48b-25f068bd2357 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:47:59.802221 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161d393-2a44-40eb-b869-0de252c6c8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:47:59.802984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161d393-2a44-40eb-b869-0de252c6c8a1 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:59.803175 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161d393-2a44-40eb-b869-0de252c6c8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:59.803422 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161d393-2a44-40eb-b869-0de252c6c8a1 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:59.804175 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161d393-2a44-40eb-b869-0de252c6c8a1 None admin] RBAC: Adding query filter params (name=network) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:47:59.804478 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161d393-2a44-40eb-b869-0de252c6c8a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:47:59.805848 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161d393-2a44-40eb-b869-0de252c6c8a1 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:47:59.813902 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 357/713] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 3 09:47:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:47:59.816334 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a974c1-3bc5-4d41-859c-d17614d5c376 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:47:59.828292 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d103c5-be75-4e75-85ab-6465a0474e83 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:59.828474 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d103c5-be75-4e75-85ab-6465a0474e83 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:59.828782 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d103c5-be75-4e75-85ab-6465a0474e83 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:59.830502 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 358/714] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:47:59.836312 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef6a79-fc85-43f5-86fe-40b3dfc8db4a None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:47:59.836590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef6a79-fc85-43f5-86fe-40b3dfc8db4a None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:47:59.836863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef6a79-fc85-43f5-86fe-40b3dfc8db4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:47:59.855979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-d5ef6a79-fc85-43f5-86fe-40b3dfc8db4a None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:47:59.857148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-d5ef6a79-fc85-43f5-86fe-40b3dfc8db4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:47:59.976392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 359/715] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:47:59.997615 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef6a79-fc85-43f5-86fe-40b3dfc8db4a None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:00.012711 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a974c1-3bc5-4d41-859c-d17614d5c376 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:00.077337 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06fa81-763f-4568-b1c3-df8e042593bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:00.078029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06fa81-763f-4568-b1c3-df8e042593bd None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:00.078370 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06fa81-763f-4568-b1c3-df8e042593bd None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:00.078589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06fa81-763f-4568-b1c3-df8e042593bd None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:00.079302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06fa81-763f-4568-b1c3-df8e042593bd None admin] RBAC: Adding query filter params (type=network) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:00.079607 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06fa81-763f-4568-b1c3-df8e042593bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:00.080995 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06fa81-763f-4568-b1c3-df8e042593bd None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:00.087287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 357/716] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 3 09:47:59 2022] GET /identity/v3/services?type=network => generated 124 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:00.137430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef6a79-fc85-43f5-86fe-40b3dfc8db4a None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:00.177446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149bc2-ec61-47be-87f7-67f78f16e48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:00.178412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149bc2-ec61-47be-87f7-67f78f16e48d None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:00.178697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149bc2-ec61-47be-87f7-67f78f16e48d None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:00.178976 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149bc2-ec61-47be-87f7-67f78f16e48d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:00.179817 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e149bc2-ec61-47be-87f7-67f78f16e48d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:00.181525 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e149bc2-ec61-47be-87f7-67f78f16e48d None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:00.201699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-1e149bc2-ec61-47be-87f7-67f78f16e48d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 09:48:00.201699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:00.201699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:00.201699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:00.201699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:00.201699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:00.201699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:00.201699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:00.201699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 09:48:00.201699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:00.201699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:00.201699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:00.201699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:00.201699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:00.201699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:00.201699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:00.202737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:00.202737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:00.202737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:00.202737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:00.202737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:00.202737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:00.202737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:00.202737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:00.202737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:00.202737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:00.202737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:00.202737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:00.202737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:00.202737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:00.202737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:00.202737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:00.203550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:00.203550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:00.203550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:00.203550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:00.203550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:00.203550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:00.203550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:00.203550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:00.203550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:00.203550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:00.203550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:00.203550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:00.203550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:00.203550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 09:48:00.203550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:00.207660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 360/717] 10.222.0.55 () {56 vars in 1129 bytes} [Tue May 3 09:47:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:00.213856 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06fa81-763f-4568-b1c3-df8e042593bd None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:00.341826 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06fa81-763f-4568-b1c3-df8e042593bd None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:00.375142 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324662b-e34c-496d-93b3-588cf52d6bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:00.375812 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324662b-e34c-496d-93b3-588cf52d6bce None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:00.376092 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324662b-e34c-496d-93b3-588cf52d6bce None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:00.376364 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324662b-e34c-496d-93b3-588cf52d6bce None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:00.377076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324662b-e34c-496d-93b3-588cf52d6bce None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:00.377383 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324662b-e34c-496d-93b3-588cf52d6bce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:00.378771 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324662b-e34c-496d-93b3-588cf52d6bce None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:00.383854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 358/718] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 3 09:48:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:00.389353 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149bc2-ec61-47be-87f7-67f78f16e48d None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:00.491972 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149bc2-ec61-47be-87f7-67f78f16e48d None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:00.526535 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973671e-6bce-45ad-be63-469e675fbba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:00.527212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973671e-6bce-45ad-be63-469e675fbba4 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:00.527494 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973671e-6bce-45ad-be63-469e675fbba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:00.527770 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973671e-6bce-45ad-be63-469e675fbba4 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:00.528481 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973671e-6bce-45ad-be63-469e675fbba4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:00.528906 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973671e-6bce-45ad-be63-469e675fbba4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:00.530310 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973671e-6bce-45ad-be63-469e675fbba4 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:00.536273 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 361/719] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 3 09:48:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:01.587239 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c1de5-2afb-460d-aab4-67d14e9987f6 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:01.588242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c1de5-2afb-460d-aab4-67d14e9987f6 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:01.588720 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c1de5-2afb-460d-aab4-67d14e9987f6 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:01.590560 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 359/720] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:01.596215 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087a3e1-f2db-4a5d-a813-a01f9238f8c4 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:01.596665 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087a3e1-f2db-4a5d-a813-a01f9238f8c4 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:01.596767 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087a3e1-f2db-4a5d-a813-a01f9238f8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:01.616602 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-6087a3e1-f2db-4a5d-a813-a01f9238f8c4 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:01.618109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-6087a3e1-f2db-4a5d-a813-a01f9238f8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:01.702205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 362/721] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:48:01.735923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c1de5-2afb-460d-aab4-67d14e9987f6 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:01.863537 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c1de5-2afb-460d-aab4-67d14e9987f6 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:01.906536 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e497b5-dd7f-4cdb-b8cc-3f1d747d9452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:01.907579 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e497b5-dd7f-4cdb-b8cc-3f1d747d9452 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:01.908015 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e497b5-dd7f-4cdb-b8cc-3f1d747d9452 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:01.908422 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e497b5-dd7f-4cdb-b8cc-3f1d747d9452 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:01.921521 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e497b5-dd7f-4cdb-b8cc-3f1d747d9452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:48:01.929413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-c9e497b5-dd7f-4cdb-b8cc-3f1d747d9452 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:48:01.929413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:01.929413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:01.929413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:01.929413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:01.929413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:01.929413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:01.929413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:01.929413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:01.929413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:01.929413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:01.929413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:01.929413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:48:01.929413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:48:01.929413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:48:01.929413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:48:01.930517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:48:01.930517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:48:01.930517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:48:01.930517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:48:01.930517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:01.930517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:01.930517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:01.930517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:01.930517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:01.930517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:01.930517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:01.930517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:01.930517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:01.930517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:01.930517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:01.930517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:01.931631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:01.931631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:01.931631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:01.931631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:01.931631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:48:01.931631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:48:01.931631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:48:01.931631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:48:01.931631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:48:01.931631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:48:01.931631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:48:01.931631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:01.939875 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 360/722] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:48:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:01.941207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087a3e1-f2db-4a5d-a813-a01f9238f8c4 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:02.115799 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087a3e1-f2db-4a5d-a813-a01f9238f8c4 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:02.166181 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4364b-8985-450a-9ab0-a76f32f73b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:02.166888 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4364b-8985-450a-9ab0-a76f32f73b6b None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:02.167169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4364b-8985-450a-9ab0-a76f32f73b6b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:02.167443 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4364b-8985-450a-9ab0-a76f32f73b6b None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:02.168221 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4364b-8985-450a-9ab0-a76f32f73b6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:02.168527 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4364b-8985-450a-9ab0-a76f32f73b6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:02.169966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4364b-8985-450a-9ab0-a76f32f73b6b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:02.182131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 363/723] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:48:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:02.187682 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e497b5-dd7f-4cdb-b8cc-3f1d747d9452 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:02.277884 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f42db7-2dee-41da-9927-a20fcd08da87 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:02.278210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f42db7-2dee-41da-9927-a20fcd08da87 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:02.278374 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f42db7-2dee-41da-9927-a20fcd08da87 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:02.279862 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 364/724] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:48:02.292312 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd273b8b-97b5-457f-9d7d-43565fc92e14 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:02.292600 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd273b8b-97b5-457f-9d7d-43565fc92e14 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:02.292874 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd273b8b-97b5-457f-9d7d-43565fc92e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:02.323783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-cd273b8b-97b5-457f-9d7d-43565fc92e14 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:02.324962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-cd273b8b-97b5-457f-9d7d-43565fc92e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:02.336624 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e497b5-dd7f-4cdb-b8cc-3f1d747d9452 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:02.372213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc8f33-8e44-47dc-a0fb-a5c6c83aeb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:02.373282 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc8f33-8e44-47dc-a0fb-a5c6c83aeb80 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:02.373729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc8f33-8e44-47dc-a0fb-a5c6c83aeb80 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:02.374197 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc8f33-8e44-47dc-a0fb-a5c6c83aeb80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:02.387201 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc8f33-8e44-47dc-a0fb-a5c6c83aeb80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:02.389574 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc8f33-8e44-47dc-a0fb-a5c6c83aeb80 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:02.399588 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 365/725] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:48:02.400989 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da620aa6-0892-4eee-aca8-b68de737dd49 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:02.401427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da620aa6-0892-4eee-aca8-b68de737dd49 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:02.401880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da620aa6-0892-4eee-aca8-b68de737dd49 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:02.403273 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 366/726] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:02.415304 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e874e-cd32-4f5c-bcde-aa6251f7ea74 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:02.415772 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e874e-cd32-4f5c-bcde-aa6251f7ea74 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:02.416211 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e874e-cd32-4f5c-bcde-aa6251f7ea74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:02.424513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-6acc8f33-8e44-47dc-a0fb-a5c6c83aeb80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:02.424513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:02.424513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:02.424513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:02.424513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:02.424513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:02.424513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:02.424513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:02.424513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:02.424513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:02.424513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:02.424513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:02.424513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:02.424513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:02.424513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:02.425396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:02.425396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:02.425396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:02.425396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:02.425396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:02.425396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:02.425396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:02.425396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:02.425396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:02.425396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:02.425396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:02.425396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:02.425396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:02.425396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:02.425396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:02.425396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:02.425396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:02.426866 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:02.426866 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:02.426866 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:02.426866 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:02.433159 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 361/727] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:02.434294 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc8f33-8e44-47dc-a0fb-a5c6c83aeb80 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:02.438817 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-308e874e-cd32-4f5c-bcde-aa6251f7ea74 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:02.440245 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-308e874e-cd32-4f5c-bcde-aa6251f7ea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:02.521882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 367/728] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 09:48:02.523215 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e874e-cd32-4f5c-bcde-aa6251f7ea74 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:02.562050 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc8f33-8e44-47dc-a0fb-a5c6c83aeb80 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:02.601824 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea8e44-377e-4992-a593-451f4de895e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:02.603548 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea8e44-377e-4992-a593-451f4de895e7 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:02.603825 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea8e44-377e-4992-a593-451f4de895e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:02.604091 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea8e44-377e-4992-a593-451f4de895e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:02.615833 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea8e44-377e-4992-a593-451f4de895e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:48:02.623987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-84ea8e44-377e-4992-a593-451f4de895e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:48:02.623987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:02.623987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:02.623987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:02.623987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:02.623987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:02.623987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:02.623987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:02.623987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:02.623987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:02.623987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:02.623987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:02.623987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:48:02.623987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:48:02.623987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:48:02.623987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:48:02.624968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:48:02.624968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:48:02.624968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:48:02.624968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:48:02.624968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:02.624968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:02.624968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:02.624968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:02.624968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:02.624968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:02.624968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:02.624968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:02.624968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:02.624968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:02.624968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:02.624968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:02.625837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:02.625837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:02.625837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:02.625837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:02.625837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:48:02.625837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:48:02.625837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:48:02.625837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:48:02.625837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:48:02.625837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:48:02.625837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:48:02.625837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:02.625837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 362/729] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:48:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:02.630719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea8e44-377e-4992-a593-451f4de895e7 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:02.656976 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e874e-cd32-4f5c-bcde-aa6251f7ea74 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:02.691248 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74302222-9cc0-49fe-a2b9-06ada38704c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:02.692346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74302222-9cc0-49fe-a2b9-06ada38704c7 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:02.692823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74302222-9cc0-49fe-a2b9-06ada38704c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:02.693349 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74302222-9cc0-49fe-a2b9-06ada38704c7 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:02.694297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74302222-9cc0-49fe-a2b9-06ada38704c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:02.694838 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74302222-9cc0-49fe-a2b9-06ada38704c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:02.696395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74302222-9cc0-49fe-a2b9-06ada38704c7 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:02.708579 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 368/730] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:02.709774 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74302222-9cc0-49fe-a2b9-06ada38704c7 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:02.734815 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea8e44-377e-4992-a593-451f4de895e7 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:02.768618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdef1e-7262-4e31-84e3-bc368a9a4f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:02.769398 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdef1e-7262-4e31-84e3-bc368a9a4f54 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:02.769677 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdef1e-7262-4e31-84e3-bc368a9a4f54 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:02.769978 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdef1e-7262-4e31-84e3-bc368a9a4f54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:02.780324 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdef1e-7262-4e31-84e3-bc368a9a4f54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:48:02.787834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-02bdef1e-7262-4e31-84e3-bc368a9a4f54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:48:02.787834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:02.787834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:02.787834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:02.787834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:02.787834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:02.787834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:02.787834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:02.787834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:02.787834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:02.787834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:02.787834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:02.787834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:48:02.787834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:48:02.787834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:48:02.787834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:48:02.788793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:48:02.788793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:48:02.788793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:48:02.788793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:48:02.788793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:02.788793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:02.788793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:02.788793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:02.788793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:02.788793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:02.788793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:02.788793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:02.788793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:02.788793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:02.788793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:02.788793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:02.789631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:02.789631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:02.789631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:02.789631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:02.789631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:48:02.789631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:48:02.789631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:48:02.789631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:48:02.789631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:48:02.789631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:48:02.789631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:48:02.789631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:02.789631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 363/731] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:48:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:02.790371 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdef1e-7262-4e31-84e3-bc368a9a4f54 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:02.816713 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74302222-9cc0-49fe-a2b9-06ada38704c7 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:02.850014 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530408d-d1fe-4984-a3bf-31f551be553e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:02.851231 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530408d-d1fe-4984-a3bf-31f551be553e None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:02.851439 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530408d-d1fe-4984-a3bf-31f551be553e None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:02.851707 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530408d-d1fe-4984-a3bf-31f551be553e None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:02.852701 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530408d-d1fe-4984-a3bf-31f551be553e None admin] RBAC: Adding query filter params (name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:02.853155 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530408d-d1fe-4984-a3bf-31f551be553e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:02.855114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530408d-d1fe-4984-a3bf-31f551be553e None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:02.869261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 369/732] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:48:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:02.869261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530408d-d1fe-4984-a3bf-31f551be553e None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:02.891199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdef1e-7262-4e31-84e3-bc368a9a4f54 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:02.925711 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafb4d6-056f-45a0-b534-bcb4a5e6148d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:02.926564 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafb4d6-056f-45a0-b534-bcb4a5e6148d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:02.926802 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafb4d6-056f-45a0-b534-bcb4a5e6148d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:02.927068 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafb4d6-056f-45a0-b534-bcb4a5e6148d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:02.934728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafb4d6-056f-45a0-b534-bcb4a5e6148d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:02.936178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafb4d6-056f-45a0-b534-bcb4a5e6148d None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:02.950099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-0fafb4d6-056f-45a0-b534-bcb4a5e6148d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 09:48:02.950099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:02.950099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:02.950099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:02.950099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:02.950099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:02.950099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:02.950099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:02.950099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:02.950099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:02.950099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:02.950099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:02.950099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:48:02.950099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:48:02.950099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:48:02.950099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:02.951211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:02.952176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:02.952176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:02.952176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:48:02.952176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:48:02.952176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:48:02.952176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:48:02.952176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:48:02.952176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:48:02.952176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 09:48:02.952176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:02.952176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 364/733] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 3 09:48:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:02.953280 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526a0a4-0dab-42c6-8b44-7c0037536688 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:02.953280 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526a0a4-0dab-42c6-8b44-7c0037536688 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:02.953447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526a0a4-0dab-42c6-8b44-7c0037536688 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:02.954786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 365/734] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:02.957961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526a0a4-0dab-42c6-8b44-7c0037536688 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:02.979185 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530408d-d1fe-4984-a3bf-31f551be553e None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:03.011816 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a8597-8251-43d0-9c55-6009b2531f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:03.012758 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a8597-8251-43d0-9c55-6009b2531f88 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:03.013079 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a8597-8251-43d0-9c55-6009b2531f88 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:03.013294 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a8597-8251-43d0-9c55-6009b2531f88 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:03.014095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a8597-8251-43d0-9c55-6009b2531f88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:03.014393 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a8597-8251-43d0-9c55-6009b2531f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:03.015731 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a8597-8251-43d0-9c55-6009b2531f88 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:03.024410 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 370/735] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:48:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:03.025230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a8597-8251-43d0-9c55-6009b2531f88 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:03.062612 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526a0a4-0dab-42c6-8b44-7c0037536688 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:03.095660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be24e9-4928-4dba-9aca-5390bb80c008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:03.096449 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be24e9-4928-4dba-9aca-5390bb80c008 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:03.096720 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be24e9-4928-4dba-9aca-5390bb80c008 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:03.096990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be24e9-4928-4dba-9aca-5390bb80c008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:03.107614 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be24e9-4928-4dba-9aca-5390bb80c008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:03.109061 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be24e9-4928-4dba-9aca-5390bb80c008 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:03.122298 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a8597-8251-43d0-9c55-6009b2531f88 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:03.125761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-60be24e9-4928-4dba-9aca-5390bb80c008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:03.125761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:03.125761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:03.125761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:03.125761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:03.125761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:03.125761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:03.125761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:03.125761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:03.125761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:03.125761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:03.125761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:03.125761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:03.125761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:03.125761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:03.126685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:03.126685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:03.126685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:03.126685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:03.126685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:03.126685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:03.126685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:03.126685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:03.126685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:03.126685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:03.126685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:03.126685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:03.126685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:03.126685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:03.126685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:03.126685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:03.126685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:03.127587 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:03.127587 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:03.127587 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:03.127587 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:03.130127 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 366/736] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:03.132005 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268990b-49ea-46a4-9556-606c1d0bd4d1 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:03.133335 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268990b-49ea-46a4-9556-606c1d0bd4d1 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:03.133593 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268990b-49ea-46a4-9556-606c1d0bd4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:03.154107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-4268990b-49ea-46a4-9556-606c1d0bd4d1 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:03.155195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-4268990b-49ea-46a4-9556-606c1d0bd4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:03.157004 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63358f-b1e7-4720-94c1-e85dcd15d8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:03.157821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63358f-b1e7-4720-94c1-e85dcd15d8e5 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:03.157977 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63358f-b1e7-4720-94c1-e85dcd15d8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:03.158642 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63358f-b1e7-4720-94c1-e85dcd15d8e5 None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:03.159048 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63358f-b1e7-4720-94c1-e85dcd15d8e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:03.159350 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63358f-b1e7-4720-94c1-e85dcd15d8e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:03.160785 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63358f-b1e7-4720-94c1-e85dcd15d8e5 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:03.182428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 371/737] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 3 09:48:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:03.183354 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63358f-b1e7-4720-94c1-e85dcd15d8e5 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:03.223144 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 367/738] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:48:03.234087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268990b-49ea-46a4-9556-606c1d0bd4d1 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:03.302314 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63358f-b1e7-4720-94c1-e85dcd15d8e5 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:03.329690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268990b-49ea-46a4-9556-606c1d0bd4d1 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:03.336206 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1bd91-a369-4d67-9922-5b61c93ee6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:03.337006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1bd91-a369-4d67-9922-5b61c93ee6cb None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:03.337279 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1bd91-a369-4d67-9922-5b61c93ee6cb None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:03.337543 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1bd91-a369-4d67-9922-5b61c93ee6cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:03.349989 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1bd91-a369-4d67-9922-5b61c93ee6cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:03.351519 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1bd91-a369-4d67-9922-5b61c93ee6cb None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:03.362767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372abf1-1232-4f93-98c8-0b79ad9dd153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:03.363612 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372abf1-1232-4f93-98c8-0b79ad9dd153 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:03.364034 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372abf1-1232-4f93-98c8-0b79ad9dd153 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:03.364445 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372abf1-1232-4f93-98c8-0b79ad9dd153 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:03.365322 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372abf1-1232-4f93-98c8-0b79ad9dd153 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:03.365771 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372abf1-1232-4f93-98c8-0b79ad9dd153 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:03.367340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372abf1-1232-4f93-98c8-0b79ad9dd153 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:03.368999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-2ce1bd91-a369-4d67-9922-5b61c93ee6cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:03.368999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:03.368999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:03.368999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:03.368999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:03.368999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:03.368999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:03.368999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:03.368999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:03.368999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:03.368999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:03.368999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:03.368999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:03.368999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:03.368999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:03.370149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:03.370149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:03.370149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:03.370149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:03.370149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:03.370149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:03.370149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:03.370149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:03.370149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:03.370149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:03.370149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:03.370149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:03.370149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:03.370149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:03.370149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:03.370149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:03.370149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:03.371183 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:03.371183 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:03.371183 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:03.371183 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:03.374625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 372/739] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:03.375479 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1bd91-a369-4d67-9922-5b61c93ee6cb None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:03.381963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 368/740] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:03.385771 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372abf1-1232-4f93-98c8-0b79ad9dd153 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:03.471978 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1bd91-a369-4d67-9922-5b61c93ee6cb None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:03.483881 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372abf1-1232-4f93-98c8-0b79ad9dd153 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:03.503493 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ea774-b23f-449c-a01a-3a4dea435eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:03.504278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ea774-b23f-449c-a01a-3a4dea435eb1 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:03.504557 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ea774-b23f-449c-a01a-3a4dea435eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:03.504830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ea774-b23f-449c-a01a-3a4dea435eb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:03.515019 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ea774-b23f-449c-a01a-3a4dea435eb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:03.516473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ea774-b23f-449c-a01a-3a4dea435eb1 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:03.518611 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7547ad-3bb0-4e5c-894e-b31c7c9df2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:03.519263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7547ad-3bb0-4e5c-894e-b31c7c9df2db None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:03.519541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7547ad-3bb0-4e5c-894e-b31c7c9df2db None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:03.519814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7547ad-3bb0-4e5c-894e-b31c7c9df2db None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:03.520529 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7547ad-3bb0-4e5c-894e-b31c7c9df2db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:03.521893 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7547ad-3bb0-4e5c-894e-b31c7c9df2db None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:03.534492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-930ea774-b23f-449c-a01a-3a4dea435eb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:03.534492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:03.534492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:03.534492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:03.534492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:03.534492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:03.534492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:03.534492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:03.534492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:03.534492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:03.534492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:03.534492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:03.534492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:03.534492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:03.534492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:03.535456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:03.535456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:03.535456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:03.535456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:03.535456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:03.535456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:03.535456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:03.535456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:03.535456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:03.535456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:03.535456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:03.535456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:03.535456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:03.535456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:03.535456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:03.535456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:03.535456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:03.536391 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:03.536391 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:03.536391 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:03.536391 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:03.536391 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 373/741] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:03.537309 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ea774-b23f-449c-a01a-3a4dea435eb1 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:03.550473 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 369/742] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 3 09:48:03 2022] POST /identity/v3/services => generated 240 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:48:03.550473 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7547ad-3bb0-4e5c-894e-b31c7c9df2db None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:03.638056 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ea774-b23f-449c-a01a-3a4dea435eb1 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:03.665825 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7547ad-3bb0-4e5c-894e-b31c7c9df2db None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:03.673396 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf492271-a6c0-4bb7-a0a7-6cda2110dd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:03.674109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf492271-a6c0-4bb7-a0a7-6cda2110dd1a None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:03.674374 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf492271-a6c0-4bb7-a0a7-6cda2110dd1a None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:03.674645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf492271-a6c0-4bb7-a0a7-6cda2110dd1a None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:03.675376 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf492271-a6c0-4bb7-a0a7-6cda2110dd1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:03.675731 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf492271-a6c0-4bb7-a0a7-6cda2110dd1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:03.677139 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf492271-a6c0-4bb7-a0a7-6cda2110dd1a None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:03.693830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 374/743] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:03.693830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13c73d-ce67-4d0a-84aa-78a4797e2f53 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:03.693830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13c73d-ce67-4d0a-84aa-78a4797e2f53 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:03.693830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13c73d-ce67-4d0a-84aa-78a4797e2f53 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:03.693830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 375/744] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:03.693830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13c73d-ce67-4d0a-84aa-78a4797e2f53 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:03.708274 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb0603-b31b-4d5e-8abd-221e94b36bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:03.709445 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb0603-b31b-4d5e-8abd-221e94b36bbf None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:03.709973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb0603-b31b-4d5e-8abd-221e94b36bbf None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:03.710461 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb0603-b31b-4d5e-8abd-221e94b36bbf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:03.718869 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb0603-b31b-4d5e-8abd-221e94b36bbf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:03.720451 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb0603-b31b-4d5e-8abd-221e94b36bbf None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:03.737361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-3aeb0603-b31b-4d5e-8abd-221e94b36bbf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 09:48:03.737361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:03.737361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:03.737361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:03.737361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:03.737361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:03.737361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:03.737361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:03.737361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:03.737361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:03.737361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:03.737361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:03.737361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:48:03.737361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:48:03.737361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:48:03.737361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:03.738495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:03.739431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:03.739431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:03.739431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:48:03.739431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:48:03.739431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:48:03.739431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:48:03.739431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:48:03.739431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:48:03.739431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 09:48:03.739431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:03.739431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 370/745] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 3 09:48:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:03.740029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c591f-9a10-469d-8443-4c073b4ec037 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:03.740029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c591f-9a10-469d-8443-4c073b4ec037 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:03.741417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c591f-9a10-469d-8443-4c073b4ec037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:03.759436 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-ee8c591f-9a10-469d-8443-4c073b4ec037 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:03.760597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-ee8c591f-9a10-469d-8443-4c073b4ec037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:03.801606 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13c73d-ce67-4d0a-84aa-78a4797e2f53 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:03.833831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 371/746] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:03 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 09:48:03.833831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c591f-9a10-469d-8443-4c073b4ec037 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:03.848083 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a4a5f-32f8-4269-822c-69809aaebbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:03.848764 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a4a5f-32f8-4269-822c-69809aaebbef None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:03.849041 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a4a5f-32f8-4269-822c-69809aaebbef None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:03.849314 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a4a5f-32f8-4269-822c-69809aaebbef None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:03.850062 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a4a5f-32f8-4269-822c-69809aaebbef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:03.850366 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a4a5f-32f8-4269-822c-69809aaebbef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:03.852499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a4a5f-32f8-4269-822c-69809aaebbef None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:03.866998 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 376/747] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:03.868037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a4a5f-32f8-4269-822c-69809aaebbef None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:03.931187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c591f-9a10-469d-8443-4c073b4ec037 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:03.963187 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a4a5f-32f8-4269-822c-69809aaebbef None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:03.963494 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7ebe9-2e60-4513-8f52-d0637432d318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:03.964287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7ebe9-2e60-4513-8f52-d0637432d318 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:03.964567 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7ebe9-2e60-4513-8f52-d0637432d318 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:03.964834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7ebe9-2e60-4513-8f52-d0637432d318 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:03.973728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7ebe9-2e60-4513-8f52-d0637432d318 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:03.975294 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7ebe9-2e60-4513-8f52-d0637432d318 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:03.990388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-ffe7ebe9-2e60-4513-8f52-d0637432d318 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 09:48:03.990388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:03.990388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:03.990388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:03.990388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:03.990388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:03.990388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:03.990388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:03.990388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:03.990388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:03.990388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:03.990388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:03.990388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:48:03.990388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:48:03.990388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:48:03.990388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:03.991505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:03.992541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:03.992541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:03.992541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:48:03.992541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:48:03.992541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:48:03.992541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:48:03.992541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:48:03.992541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:48:03.992541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 09:48:03.992541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:03.992541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 372/748] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:48:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:03.992541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7ebe9-2e60-4513-8f52-d0637432d318 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:04.004376 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ece564-1e92-41de-a37d-8166ec70ed0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:04.005196 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ece564-1e92-41de-a37d-8166ec70ed0c None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:04.005474 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ece564-1e92-41de-a37d-8166ec70ed0c None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:04.005737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ece564-1e92-41de-a37d-8166ec70ed0c None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:04.006607 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ece564-1e92-41de-a37d-8166ec70ed0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:04.006909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ece564-1e92-41de-a37d-8166ec70ed0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:04.008745 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ece564-1e92-41de-a37d-8166ec70ed0c None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:04.026005 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 377/749] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 3 09:48:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:04.026936 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ece564-1e92-41de-a37d-8166ec70ed0c None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:04.091192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7ebe9-2e60-4513-8f52-d0637432d318 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:04.120637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ece564-1e92-41de-a37d-8166ec70ed0c None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:04.123383 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e734f31-b025-4e42-8d34-050f7bf09068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:04.124045 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e734f31-b025-4e42-8d34-050f7bf09068 None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:04.124325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e734f31-b025-4e42-8d34-050f7bf09068 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:04.124700 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e734f31-b025-4e42-8d34-050f7bf09068 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:04.125418 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e734f31-b025-4e42-8d34-050f7bf09068 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:04.126834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e734f31-b025-4e42-8d34-050f7bf09068 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:04.149676 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 373/750] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 3 09:48:03 2022] POST /identity/v3/services => generated 251 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:48:04.149676 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e734f31-b025-4e42-8d34-050f7bf09068 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:04.161968 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0a32c-9f09-495e-8f98-545f5d55e1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:04.163275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0a32c-9f09-495e-8f98-545f5d55e1b2 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:04.163580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0a32c-9f09-495e-8f98-545f5d55e1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:04.163850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0a32c-9f09-495e-8f98-545f5d55e1b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:04.173387 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0a32c-9f09-495e-8f98-545f5d55e1b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:04.175460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0a32c-9f09-495e-8f98-545f5d55e1b2 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:04.194101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-40c0a32c-9f09-495e-8f98-545f5d55e1b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:04.194101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:04.194101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:04.194101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:04.194101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:04.194101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:04.194101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:04.194101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:04.194101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:04.194101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:04.194101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:04.194101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:04.194101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:48:04.194101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:48:04.194101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:48:04.195128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:48:04.195128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:04.195128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:04.195128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:04.195128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:04.195128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:04.195128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:04.195128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:04.195128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:04.195128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:04.195128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:04.195128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:04.195128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:04.195128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:04.195128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:04.195128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:04.195128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:04.196001 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:48:04.196001 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:48:04.196001 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:48:04.196001 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:48:04.196001 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:48:04.196001 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:48:04.196001 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:04.196001 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:04.196416 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 378/751] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:04.196951 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0a32c-9f09-495e-8f98-545f5d55e1b2 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:04.266901 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e734f31-b025-4e42-8d34-050f7bf09068 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:04.306737 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a7016-edb8-45d3-94ba-09458c4d75dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:04.307468 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a7016-edb8-45d3-94ba-09458c4d75dd None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:04.307750 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a7016-edb8-45d3-94ba-09458c4d75dd None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:04.308083 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a7016-edb8-45d3-94ba-09458c4d75dd None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:04.308990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a7016-edb8-45d3-94ba-09458c4d75dd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:04.309298 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a7016-edb8-45d3-94ba-09458c4d75dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:04.310792 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a7016-edb8-45d3-94ba-09458c4d75dd None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:04.332745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 374/752] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 3 09:48:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:04.333167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0a32c-9f09-495e-8f98-545f5d55e1b2 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:04.333659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a7016-edb8-45d3-94ba-09458c4d75dd None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:04.376474 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f49a4a-a519-40d8-ab84-65aad09145e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:04.377137 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f49a4a-a519-40d8-ab84-65aad09145e7 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:04.377417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f49a4a-a519-40d8-ab84-65aad09145e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:04.377692 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f49a4a-a519-40d8-ab84-65aad09145e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:04.448280 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a7016-edb8-45d3-94ba-09458c4d75dd None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:04.463379 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f49a4a-a519-40d8-ab84-65aad09145e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:04.465581 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f49a4a-a519-40d8-ab84-65aad09145e7 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:04.481046 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860dbe1-93a7-4485-9095-fa37f9e53f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:04.481721 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860dbe1-93a7-4485-9095-fa37f9e53f47 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:04.482013 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860dbe1-93a7-4485-9095-fa37f9e53f47 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:04.482284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860dbe1-93a7-4485-9095-fa37f9e53f47 None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:04.483064 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860dbe1-93a7-4485-9095-fa37f9e53f47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:04.483368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860dbe1-93a7-4485-9095-fa37f9e53f47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:04.484788 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860dbe1-93a7-4485-9095-fa37f9e53f47 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:04.500871 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 375/753] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:48:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:04.501826 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860dbe1-93a7-4485-9095-fa37f9e53f47 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:04.589837 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 379/754] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:48:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:48:04.589837 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f49a4a-a519-40d8-ab84-65aad09145e7 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:04.602382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860dbe1-93a7-4485-9095-fa37f9e53f47 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:04.636389 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c4ee8-4b04-438a-83b3-8605a8c70377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:04.637330 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c4ee8-4b04-438a-83b3-8605a8c70377 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:04.637745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c4ee8-4b04-438a-83b3-8605a8c70377 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:04.638229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c4ee8-4b04-438a-83b3-8605a8c70377 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:04.684803 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f49a4a-a519-40d8-ab84-65aad09145e7 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:04.706202 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c4ee8-4b04-438a-83b3-8605a8c70377 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:04.708289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c4ee8-4b04-438a-83b3-8605a8c70377 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:04.720305 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02659e20-0232-4715-88f4-3c7dc17666c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:04.721453 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02659e20-0232-4715-88f4-3c7dc17666c9 None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:04.721882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02659e20-0232-4715-88f4-3c7dc17666c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:04.722248 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02659e20-0232-4715-88f4-3c7dc17666c9 None admin] PATH_INFO: `/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/efb008cfc6424998917da60d72689f55/roles/52d3ad3e32c741938997691c9a909b81` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:04.724343 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02659e20-0232-4715-88f4-3c7dc17666c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f395f4842c39422d962dbddc4cf2897a, user_id=efb008cfc6424998917da60d72689f55, role_id=52d3ad3e32c741938997691c9a909b81)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:04.725904 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02659e20-0232-4715-88f4-3c7dc17666c9 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:04.749817 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 380/755] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:48:04 2022] PUT /identity/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/efb008cfc6424998917da60d72689f55/roles/52d3ad3e32c741938997691c9a909b81 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:48:04.749817 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02659e20-0232-4715-88f4-3c7dc17666c9 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:04.846186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02659e20-0232-4715-88f4-3c7dc17666c9 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:04.870252 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 376/756] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:48:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:48:04.871449 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c4ee8-4b04-438a-83b3-8605a8c70377 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:04.883947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f1ae2-554e-4834-949b-bf3b09492bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:04.889823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f1ae2-554e-4834-949b-bf3b09492bec None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:04.889823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f1ae2-554e-4834-949b-bf3b09492bec None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:04.889823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f1ae2-554e-4834-949b-bf3b09492bec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:04.896316 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f1ae2-554e-4834-949b-bf3b09492bec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:04.905825 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f1ae2-554e-4834-949b-bf3b09492bec None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:04.917558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-6a2f1ae2-554e-4834-949b-bf3b09492bec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:04.917558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:04.917558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:04.917558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:04.917558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:04.917558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:04.917558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:04.917558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:04.917558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:04.917558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:04.917558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:04.917558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:04.917558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:04.917558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:04.917558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:04.918508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:04.918508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:04.918508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:04.918508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:04.918508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:04.918508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:04.918508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:04.918508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:04.918508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:04.918508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:04.918508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:04.918508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:04.918508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:04.918508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:04.918508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:04.918508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:04.918508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:04.924115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:04.924115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:04.924115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:04.924115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:04.924115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 381/757] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:04.930365 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f1ae2-554e-4834-949b-bf3b09492bec None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:05.022087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c4ee8-4b04-438a-83b3-8605a8c70377 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:05.071259 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde5bc8-1157-4ab3-abde-f275f925e3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:05.072062 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde5bc8-1157-4ab3-abde-f275f925e3f4 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:05.072335 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde5bc8-1157-4ab3-abde-f275f925e3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:05.072598 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde5bc8-1157-4ab3-abde-f275f925e3f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:05.083286 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde5bc8-1157-4ab3-abde-f275f925e3f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:05.084737 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde5bc8-1157-4ab3-abde-f275f925e3f4 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:05.090212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f1ae2-554e-4834-949b-bf3b09492bec None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:05.105466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-0dde5bc8-1157-4ab3-abde-f275f925e3f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:05.105466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:05.105466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:05.105466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:05.105466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:05.105466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:05.105466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:05.105466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:05.105466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:05.105466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:05.105466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:05.105466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:05.105466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:05.105466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:05.105466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:05.106444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:05.106444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:05.106444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:05.106444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:05.106444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:05.106444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:05.106444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:05.106444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:05.106444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:05.106444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:05.106444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:05.106444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:05.106444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:05.106444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:05.106444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:05.106444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:05.106444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:05.107777 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:05.107777 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:05.107777 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:05.107777 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:05.107777 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 377/758] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:05.112750 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde5bc8-1157-4ab3-abde-f275f925e3f4 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:05.129678 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd2c3c-4dcc-43ba-b6ac-fe93d189c6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:05.130577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd2c3c-4dcc-43ba-b6ac-fe93d189c6eb None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:05.131156 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd2c3c-4dcc-43ba-b6ac-fe93d189c6eb None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:05.131434 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd2c3c-4dcc-43ba-b6ac-fe93d189c6eb None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:05.132207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd2c3c-4dcc-43ba-b6ac-fe93d189c6eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:05.132775 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd2c3c-4dcc-43ba-b6ac-fe93d189c6eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:05.135211 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd2c3c-4dcc-43ba-b6ac-fe93d189c6eb None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:05.149967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 382/759] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:05.162902 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd2c3c-4dcc-43ba-b6ac-fe93d189c6eb None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:05.272279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde5bc8-1157-4ab3-abde-f275f925e3f4 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:05.322351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50284e58-8a50-491e-a625-c8986cefb032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:05.323081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50284e58-8a50-491e-a625-c8986cefb032 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:05.323359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50284e58-8a50-491e-a625-c8986cefb032 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:05.323630 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50284e58-8a50-491e-a625-c8986cefb032 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:05.324356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50284e58-8a50-491e-a625-c8986cefb032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:05.324653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50284e58-8a50-491e-a625-c8986cefb032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:05.325880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd2c3c-4dcc-43ba-b6ac-fe93d189c6eb None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:05.326075 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50284e58-8a50-491e-a625-c8986cefb032 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:05.354202 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 378/760] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:05.355165 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50284e58-8a50-491e-a625-c8986cefb032 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:05.359358 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87f2b7-3d23-42c7-91b9-2132df89de5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:05.360100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87f2b7-3d23-42c7-91b9-2132df89de5b None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:05.360379 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87f2b7-3d23-42c7-91b9-2132df89de5b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:05.360648 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87f2b7-3d23-42c7-91b9-2132df89de5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:05.367884 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87f2b7-3d23-42c7-91b9-2132df89de5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:05.369342 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87f2b7-3d23-42c7-91b9-2132df89de5b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:05.483055 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50284e58-8a50-491e-a625-c8986cefb032 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:05.517944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec2026-5e35-41ff-b0b3-5cf68518249a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:05.518740 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec2026-5e35-41ff-b0b3-5cf68518249a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:05.519015 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec2026-5e35-41ff-b0b3-5cf68518249a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:05.519281 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec2026-5e35-41ff-b0b3-5cf68518249a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:05.526691 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec2026-5e35-41ff-b0b3-5cf68518249a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:05.528152 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec2026-5e35-41ff-b0b3-5cf68518249a None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:05.543685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-8aec2026-5e35-41ff-b0b3-5cf68518249a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:05.543685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:05.543685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:05.543685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:05.543685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:05.543685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:05.543685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:05.543685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:05.543685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:05.543685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:05.543685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:05.543685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:05.543685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:48:05.543685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:48:05.543685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:48:05.544627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:48:05.544627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:05.544627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:05.544627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:05.544627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:05.544627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:05.544627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:05.544627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:05.544627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:05.544627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:05.544627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:05.544627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:05.544627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:05.544627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:05.544627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:05.544627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:05.544627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:05.545975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:48:05.545975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:48:05.545975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:48:05.545975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:48:05.545975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:48:05.545975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:48:05.545975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:05.545975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:05.545975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 379/761] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:05.550907 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec2026-5e35-41ff-b0b3-5cf68518249a None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:05.595590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-fe87f2b7-3d23-42c7-91b9-2132df89de5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:05.595590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:05.595590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:05.595590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:05.595590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:05.595590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:05.595590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:05.595590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:05.595590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:05.595590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:05.595590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:05.595590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:05.595590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:48:05.595590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:48:05.595590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:48:05.596542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:48:05.596542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:05.596542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:05.596542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:05.596542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:05.596542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:05.596542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:05.596542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:05.596542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:05.596542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:05.596542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:05.596542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:05.596542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:05.596542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:05.596542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:05.596542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:05.596542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:05.598480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:48:05.598480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:48:05.598480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:48:05.598480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:48:05.598480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:48:05.598480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:48:05.598480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:05.598480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:05.598480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 383/762] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:05.605180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87f2b7-3d23-42c7-91b9-2132df89de5b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:05.647999 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec2026-5e35-41ff-b0b3-5cf68518249a None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:05.681321 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b9d8a-4f4c-4b5b-82f4-9f30e71cbee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:05.682018 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b9d8a-4f4c-4b5b-82f4-9f30e71cbee2 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:05.682322 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b9d8a-4f4c-4b5b-82f4-9f30e71cbee2 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:05.682589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b9d8a-4f4c-4b5b-82f4-9f30e71cbee2 None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:05.683370 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b9d8a-4f4c-4b5b-82f4-9f30e71cbee2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:05.683670 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b9d8a-4f4c-4b5b-82f4-9f30e71cbee2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:05.685126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b9d8a-4f4c-4b5b-82f4-9f30e71cbee2 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:05.697119 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 380/763] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:48:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:05.702911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b9d8a-4f4c-4b5b-82f4-9f30e71cbee2 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:05.738108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87f2b7-3d23-42c7-91b9-2132df89de5b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:05.778478 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b9c8f-faeb-4d96-967f-445479476a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:05.779145 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b9c8f-faeb-4d96-967f-445479476a1b None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:05.779419 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b9c8f-faeb-4d96-967f-445479476a1b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:05.779684 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b9c8f-faeb-4d96-967f-445479476a1b None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:05.780467 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b9c8f-faeb-4d96-967f-445479476a1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:05.780771 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b9c8f-faeb-4d96-967f-445479476a1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:05.782607 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b9c8f-faeb-4d96-967f-445479476a1b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:05.804145 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 384/764] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:48:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:05.812862 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b9c8f-faeb-4d96-967f-445479476a1b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:05.891816 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b9d8a-4f4c-4b5b-82f4-9f30e71cbee2 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:05.967685 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b9c8f-faeb-4d96-967f-445479476a1b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:05.969926 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e06e08-e7fc-4480-893c-28d927a0320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:05.971196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e06e08-e7fc-4480-893c-28d927a0320c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:05.971196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e06e08-e7fc-4480-893c-28d927a0320c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:05.971196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e06e08-e7fc-4480-893c-28d927a0320c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:05.971987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e06e08-e7fc-4480-893c-28d927a0320c None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=73dfc1b485d647f1ae59a405c978599f) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:05.972296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e06e08-e7fc-4480-893c-28d927a0320c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:05.973717 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e06e08-e7fc-4480-893c-28d927a0320c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:06.005824 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 381/765] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:48:05 2022] GET /identity/v3/role_assignments?user.id=73dfc1b485d647f1ae59a405c978599f&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=52d3ad3e32c741938997691c9a909b81 => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:06.010199 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d8148-efd5-4c94-9ed9-13978b7650f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:06.011235 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d8148-efd5-4c94-9ed9-13978b7650f6 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:06.011708 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d8148-efd5-4c94-9ed9-13978b7650f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:06.012191 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d8148-efd5-4c94-9ed9-13978b7650f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:06.013306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d8148-efd5-4c94-9ed9-13978b7650f6 None admin] RBAC: Adding query filter params (role.id=779b01e1e2534bfba9971e7000b7c628, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=62b336ab0cfd4bfd9ec498dcd940332f) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:06.013874 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d8148-efd5-4c94-9ed9-13978b7650f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:06.015591 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d8148-efd5-4c94-9ed9-13978b7650f6 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:06.030837 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 385/766] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:48:05 2022] GET /identity/v3/role_assignments?user.id=62b336ab0cfd4bfd9ec498dcd940332f&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=779b01e1e2534bfba9971e7000b7c628 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:06.148668 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28410485-74a3-46aa-b5d7-7e27378eb0d3 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:06.148998 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28410485-74a3-46aa-b5d7-7e27378eb0d3 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:06.149212 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28410485-74a3-46aa-b5d7-7e27378eb0d3 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:06.150822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 382/767] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:06.167796 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a05f0-7244-4488-a7ff-8edd134bb3d5 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:06.168444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a05f0-7244-4488-a7ff-8edd134bb3d5 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:06.168908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a05f0-7244-4488-a7ff-8edd134bb3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:06.192765 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-e31a05f0-7244-4488-a7ff-8edd134bb3d5 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:06.194789 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-e31a05f0-7244-4488-a7ff-8edd134bb3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:06.293812 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 386/768] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:06.313048 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28410485-74a3-46aa-b5d7-7e27378eb0d3 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:06.454245 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28410485-74a3-46aa-b5d7-7e27378eb0d3 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:06.506214 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878b0d2-c209-4aaa-973c-337e14505a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:06.507021 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b0d2-c209-4aaa-973c-337e14505a96 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:06.507323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b0d2-c209-4aaa-973c-337e14505a96 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:06.507593 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b0d2-c209-4aaa-973c-337e14505a96 None admin] PATH_INFO: `/v3/services/network` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:06.508551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878b0d2-c209-4aaa-973c-337e14505a96 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:06.509948 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878b0d2-c209-4aaa-973c-337e14505a96 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:06.528020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-7878b0d2-c209-4aaa-973c-337e14505a96 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 09:48:06.528020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:06.528020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:06.528020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:06.528020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:06.528020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:06.528020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:06.528020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:06.528020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 09:48:06.528020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:06.528020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:06.528020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:06.528020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:06.528020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:06.528020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:06.528020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:06.528020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:06.529052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:06.529052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:06.529052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:06.529052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:06.529052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:06.529052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:06.529052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:06.529052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:06.529052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:06.529052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:06.529052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:06.529052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:06.529052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:06.529052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:06.529052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:06.529052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:06.529929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:06.529929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:06.529929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:06.529929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:06.529929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:06.529929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:06.529929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:06.529929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:06.529929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:06.529929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:06.529929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:06.529929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:06.529929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 09:48:06.529929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:06.529929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 383/769] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:06 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:06.535408 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a05f0-7244-4488-a7ff-8edd134bb3d5 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:06.646271 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a05f0-7244-4488-a7ff-8edd134bb3d5 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:06.656017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002de7ab-14c5-4a87-96a5-e2eb8bc8c726 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:06.656281 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002de7ab-14c5-4a87-96a5-e2eb8bc8c726 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:06.656557 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002de7ab-14c5-4a87-96a5-e2eb8bc8c726 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:06.658175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 384/770] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:06.662923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a388e34-fc28-4219-9351-5f42d29c7077 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:06.663200 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a388e34-fc28-4219-9351-5f42d29c7077 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:06.663493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a388e34-fc28-4219-9351-5f42d29c7077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:06.679282 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80107268-6d2a-4839-9377-f7a52a09c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:06.679959 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80107268-6d2a-4839-9377-f7a52a09c785 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:06.680231 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80107268-6d2a-4839-9377-f7a52a09c785 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:06.680499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80107268-6d2a-4839-9377-f7a52a09c785 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:06.681200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80107268-6d2a-4839-9377-f7a52a09c785 None admin] RBAC: Adding query filter params (name=network) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:06.681498 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80107268-6d2a-4839-9377-f7a52a09c785 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:06.682944 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80107268-6d2a-4839-9377-f7a52a09c785 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:06.687907 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 387/771] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 3 09:48:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:06.693103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80107268-6d2a-4839-9377-f7a52a09c785 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:06.694950 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-6a388e34-fc28-4219-9351-5f42d29c7077 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:06.696418 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-6a388e34-fc28-4219-9351-5f42d29c7077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:06.913437 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80107268-6d2a-4839-9377-f7a52a09c785 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:06.936481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 385/772] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:06.961969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d046b0c-2330-4209-aaba-e47a40723c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:06.962991 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d046b0c-2330-4209-aaba-e47a40723c23 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:06.963467 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d046b0c-2330-4209-aaba-e47a40723c23 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:06.963956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d046b0c-2330-4209-aaba-e47a40723c23 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:06.964853 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d046b0c-2330-4209-aaba-e47a40723c23 None admin] RBAC: Adding query filter params (type=network) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:06.965348 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d046b0c-2330-4209-aaba-e47a40723c23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:06.966938 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d046b0c-2330-4209-aaba-e47a40723c23 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:06.974077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 388/773] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 3 09:48:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:06.981837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a388e34-fc28-4219-9351-5f42d29c7077 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:06.985257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d046b0c-2330-4209-aaba-e47a40723c23 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:07.130363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d046b0c-2330-4209-aaba-e47a40723c23 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:07.176431 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a89f14-75eb-48cb-85c0-0560ec86aa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:07.177618 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a89f14-75eb-48cb-85c0-0560ec86aa33 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:07.178196 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a89f14-75eb-48cb-85c0-0560ec86aa33 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:07.179133 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a89f14-75eb-48cb-85c0-0560ec86aa33 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:07.180071 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a89f14-75eb-48cb-85c0-0560ec86aa33 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:07.181819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a89f14-75eb-48cb-85c0-0560ec86aa33 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:07.194903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-00a89f14-75eb-48cb-85c0-0560ec86aa33 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 09:48:07.194903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:07.194903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:07.194903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:07.194903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:07.194903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:07.194903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:07.194903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:07.194903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 09:48:07.194903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:07.194903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:07.194903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:07.194903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:07.194903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:07.194903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:07.194903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:07.196061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:07.196061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:07.196061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:07.196061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:07.196061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:07.196061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:07.196061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:07.196061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:07.196061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:07.196061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:07.196061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:07.196061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:07.196061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:07.196061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:07.196061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:07.196061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:07.196885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:07.196885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:07.196885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:07.196885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:07.196885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:07.196885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:07.196885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:07.196885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:07.196885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:07.196885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:07.196885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:07.196885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:07.196885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:07.196885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 09:48:07.196885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:07.203166 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 389/774] 10.222.0.55 () {56 vars in 1129 bytes} [Tue May 3 09:48:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:07.220393 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a89f14-75eb-48cb-85c0-0560ec86aa33 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:07.260282 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a388e34-fc28-4219-9351-5f42d29c7077 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:07.394595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f937d3c-f672-47a3-a9bc-5eb0b8fed111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:07.395284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f937d3c-f672-47a3-a9bc-5eb0b8fed111 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:07.395924 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f937d3c-f672-47a3-a9bc-5eb0b8fed111 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:07.395924 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f937d3c-f672-47a3-a9bc-5eb0b8fed111 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:07.396608 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f937d3c-f672-47a3-a9bc-5eb0b8fed111 None admin] RBAC: Adding query filter params (interface=public, service_id=0cf9590869f944db908db107dc11f7c3, region_id=RegionOne) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:07.396913 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f937d3c-f672-47a3-a9bc-5eb0b8fed111 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:07.398681 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f937d3c-f672-47a3-a9bc-5eb0b8fed111 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:07.418461 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 386/775] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 3 09:48:06 2022] GET /identity/v3/endpoints?service_id=0cf9590869f944db908db107dc11f7c3&interface=public®ion_id=RegionOne => generated 194 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:07.423508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f937d3c-f672-47a3-a9bc-5eb0b8fed111 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:07.581576 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f937d3c-f672-47a3-a9bc-5eb0b8fed111 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:07.617854 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a89f14-75eb-48cb-85c0-0560ec86aa33 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:07.634699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efc134-bc04-4290-ae9c-6200075d2051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:07.635016 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efc134-bc04-4290-ae9c-6200075d2051 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:07.635805 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efc134-bc04-4290-ae9c-6200075d2051 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:07.635805 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efc134-bc04-4290-ae9c-6200075d2051 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:07.636224 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efc134-bc04-4290-ae9c-6200075d2051 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:07.639400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efc134-bc04-4290-ae9c-6200075d2051 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:07.650452 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 387/776] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 3 09:48:07 2022] GET /identity/v3/services => generated 772 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:07.651813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ad7d9-272d-486c-91e6-f25d9f2ab165 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:07.652095 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ad7d9-272d-486c-91e6-f25d9f2ab165 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:07.657903 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ad7d9-272d-486c-91e6-f25d9f2ab165 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:07.658307 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 388/777] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:07.659749 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea5ca3-226a-482e-a524-a47e529440ec None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:07.660012 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea5ca3-226a-482e-a524-a47e529440ec None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:07.660295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea5ca3-226a-482e-a524-a47e529440ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:07.688348 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89486976-b7ad-4c27-94ef-399368a844a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:07.689042 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486976-b7ad-4c27-94ef-399368a844a0 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:07.689319 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486976-b7ad-4c27-94ef-399368a844a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:07.689823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486976-b7ad-4c27-94ef-399368a844a0 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:07.690334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89486976-b7ad-4c27-94ef-399368a844a0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:07.690637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89486976-b7ad-4c27-94ef-399368a844a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:07.692040 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89486976-b7ad-4c27-94ef-399368a844a0 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:07.698905 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-b5ea5ca3-226a-482e-a524-a47e529440ec None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:07.700105 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-b5ea5ca3-226a-482e-a524-a47e529440ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:07.705927 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 390/778] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 3 09:48:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:07.711761 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89486976-b7ad-4c27-94ef-399368a844a0 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:07.823134 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89486976-b7ad-4c27-94ef-399368a844a0 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:07.863615 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 389/779] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:07.864599 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21cc11-db8f-45ca-b886-66868561c5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:07.865283 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21cc11-db8f-45ca-b886-66868561c5e3 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:07.865559 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21cc11-db8f-45ca-b886-66868561c5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:07.865849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21cc11-db8f-45ca-b886-66868561c5e3 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:07.866568 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21cc11-db8f-45ca-b886-66868561c5e3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:07.866928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21cc11-db8f-45ca-b886-66868561c5e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:07.868316 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21cc11-db8f-45ca-b886-66868561c5e3 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:07.878629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 391/780] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 3 09:48:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:07.885049 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea5ca3-226a-482e-a524-a47e529440ec None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:07.889930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21cc11-db8f-45ca-b886-66868561c5e3 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:08.004689 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea5ca3-226a-482e-a524-a47e529440ec None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:08.021841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21cc11-db8f-45ca-b886-66868561c5e3 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:08.047988 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a52f1b-f9ff-4502-b699-499241a4ed2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:08.048650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a52f1b-f9ff-4502-b699-499241a4ed2d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:08.048922 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a52f1b-f9ff-4502-b699-499241a4ed2d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:08.049195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a52f1b-f9ff-4502-b699-499241a4ed2d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:08.050005 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a52f1b-f9ff-4502-b699-499241a4ed2d None admin] RBAC: Adding query filter params (interface=public, service_id=c6b43e13454847c7b0dceee503c8959e, region_id=RegionOne) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:08.050311 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a52f1b-f9ff-4502-b699-499241a4ed2d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:08.051664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a52f1b-f9ff-4502-b699-499241a4ed2d None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:08.064699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 390/781] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 3 09:48:07 2022] GET /identity/v3/endpoints?service_id=c6b43e13454847c7b0dceee503c8959e&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:08.070487 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a52f1b-f9ff-4502-b699-499241a4ed2d None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:08.087741 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39b154-bdd1-459e-a38f-779f300a4290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:08.088538 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39b154-bdd1-459e-a38f-779f300a4290 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:08.088811 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39b154-bdd1-459e-a38f-779f300a4290 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:08.089082 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39b154-bdd1-459e-a38f-779f300a4290 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:08.117924 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39b154-bdd1-459e-a38f-779f300a4290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:48:08.122693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-ad39b154-bdd1-459e-a38f-779f300a4290 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:48:08.122693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:08.122693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:08.122693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:08.122693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:08.122693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:08.122693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:08.122693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:08.122693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:08.122693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:08.122693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:08.122693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:08.122693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:48:08.122693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:48:08.122693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:48:08.122693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:48:08.123601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:48:08.123601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:48:08.123601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:48:08.123601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:48:08.123601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:08.123601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:08.123601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:08.123601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:08.123601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:08.123601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:08.123601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:08.123601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:08.123601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:08.123601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:08.123601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:08.123601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:08.124455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:08.124455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:08.124455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:08.124455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:08.124455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:48:08.124455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:48:08.124455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:48:08.124455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:48:08.124455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:48:08.124455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:48:08.124455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:48:08.124455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:08.127202 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 392/782] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:48:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:08.132586 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39b154-bdd1-459e-a38f-779f300a4290 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:08.193286 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a52f1b-f9ff-4502-b699-499241a4ed2d None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:08.234139 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc545894-060b-4ef1-8f54-5e8f3c7c32d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:08.234806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc545894-060b-4ef1-8f54-5e8f3c7c32d4 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:08.235081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc545894-060b-4ef1-8f54-5e8f3c7c32d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:08.235346 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc545894-060b-4ef1-8f54-5e8f3c7c32d4 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:08.236032 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc545894-060b-4ef1-8f54-5e8f3c7c32d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:08.237386 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc545894-060b-4ef1-8f54-5e8f3c7c32d4 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:08.243797 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 391/783] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 3 09:48:08 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:08.357904 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39b154-bdd1-459e-a38f-779f300a4290 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:08.410995 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b452a-71f6-4689-8420-f85db8aecdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:08.411589 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b452a-71f6-4689-8420-f85db8aecdc0 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:08.411867 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b452a-71f6-4689-8420-f85db8aecdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:08.412137 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b452a-71f6-4689-8420-f85db8aecdc0 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:08.412884 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b452a-71f6-4689-8420-f85db8aecdc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:08.413184 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b452a-71f6-4689-8420-f85db8aecdc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:08.414690 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b452a-71f6-4689-8420-f85db8aecdc0 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:08.429959 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 393/784] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:48:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:08.436125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc545894-060b-4ef1-8f54-5e8f3c7c32d4 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:08.554373 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc545894-060b-4ef1-8f54-5e8f3c7c32d4 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:08.598537 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16a254-a705-4222-9091-9e410e42bc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:08.599358 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16a254-a705-4222-9091-9e410e42bc07 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:08.599635 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16a254-a705-4222-9091-9e410e42bc07 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:08.599904 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16a254-a705-4222-9091-9e410e42bc07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:08.611439 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16a254-a705-4222-9091-9e410e42bc07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:08.612880 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16a254-a705-4222-9091-9e410e42bc07 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:08.636229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-9b16a254-a705-4222-9091-9e410e42bc07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:08.636229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:08.636229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:08.636229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:08.636229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:08.636229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:08.636229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:08.636229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:08.636229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:08.636229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:08.636229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:08.636229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:08.636229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:08.636229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:08.636229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:08.637213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:08.637213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:08.637213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:08.637213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:08.637213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:08.637213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:08.637213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:08.637213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:08.637213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:08.637213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:08.637213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:08.637213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:08.637213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:08.637213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:08.637213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:08.637213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:08.637213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:08.638145 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:08.638145 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:08.638145 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:08.638145 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:08.638145 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 392/785] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:08.643168 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b452a-71f6-4689-8420-f85db8aecdc0 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:08.678932 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404104a-c1c2-48f4-ae91-a38dbf618026 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:08.679659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404104a-c1c2-48f4-ae91-a38dbf618026 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:08.679994 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404104a-c1c2-48f4-ae91-a38dbf618026 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:08.686602 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 393/786] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:48:08.692417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfa893-aed7-4aa6-abf5-e5bc1c674c98 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:08.692750 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfa893-aed7-4aa6-abf5-e5bc1c674c98 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:08.692963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfa893-aed7-4aa6-abf5-e5bc1c674c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:08.733093 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-57cfa893-aed7-4aa6-abf5-e5bc1c674c98 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:08.734461 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-57cfa893-aed7-4aa6-abf5-e5bc1c674c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:08.757982 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b452a-71f6-4689-8420-f85db8aecdc0 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:08.797821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e69b89-294e-4191-a496-7d89f6926585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:08.797821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e69b89-294e-4191-a496-7d89f6926585 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:08.797821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e69b89-294e-4191-a496-7d89f6926585 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:08.797821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e69b89-294e-4191-a496-7d89f6926585 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:08.798244 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e69b89-294e-4191-a496-7d89f6926585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:08.798244 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e69b89-294e-4191-a496-7d89f6926585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:08.798244 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e69b89-294e-4191-a496-7d89f6926585 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:08.813029 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 394/787] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:08.818245 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e69b89-294e-4191-a496-7d89f6926585 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:08.882457 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 394/788] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:48:08.887024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0ea9-c6ef-46fa-8d70-a609fda0e73d None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:08.887312 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0ea9-c6ef-46fa-8d70-a609fda0e73d None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:08.887584 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0ea9-c6ef-46fa-8d70-a609fda0e73d None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:08.888882 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 395/789] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:48:08.895468 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ebd05-cc94-4846-b07c-82c0be943177 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:08.895968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ebd05-cc94-4846-b07c-82c0be943177 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:08.896429 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ebd05-cc94-4846-b07c-82c0be943177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:08.919368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-755ebd05-cc94-4846-b07c-82c0be943177 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:08.921226 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-755ebd05-cc94-4846-b07c-82c0be943177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:08.951002 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e69b89-294e-4191-a496-7d89f6926585 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:08.985155 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d38b45-9bbb-4617-92e4-cb279cbddcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:08.986293 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d38b45-9bbb-4617-92e4-cb279cbddcda None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:08.986749 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d38b45-9bbb-4617-92e4-cb279cbddcda None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:08.987194 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d38b45-9bbb-4617-92e4-cb279cbddcda None admin] PATH_INFO: `/v3/users/nova` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:08.995812 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d38b45-9bbb-4617-92e4-cb279cbddcda None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:08.997480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d38b45-9bbb-4617-92e4-cb279cbddcda None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:09.013817 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 396/790] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:09.013817 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ebd05-cc94-4846-b07c-82c0be943177 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:09.019318 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-a1d38b45-9bbb-4617-92e4-cb279cbddcda None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 09:48:09.019318 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:09.019318 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:09.019318 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:09.019318 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:09.019318 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:09.019318 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:09.019318 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:09.019318 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:09.019318 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:09.019318 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:09.019318 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:09.019318 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:48:09.019318 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:48:09.019318 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:48:09.019318 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:09.020345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:09.021275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:09.021275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:09.021275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:48:09.021275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:48:09.021275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:48:09.021275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:48:09.021275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:48:09.021275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:48:09.021275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 09:48:09.021275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:09.023927 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 395/791] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 3 09:48:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:09.030997 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d38b45-9bbb-4617-92e4-cb279cbddcda None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:09.126846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ebd05-cc94-4846-b07c-82c0be943177 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:09.155999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d38b45-9bbb-4617-92e4-cb279cbddcda None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:09.161002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38ab50-46fd-40a1-bf1a-e5a022c6a85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:09.162073 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38ab50-46fd-40a1-bf1a-e5a022c6a85f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:09.162524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38ab50-46fd-40a1-bf1a-e5a022c6a85f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:09.162966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38ab50-46fd-40a1-bf1a-e5a022c6a85f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:09.173581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38ab50-46fd-40a1-bf1a-e5a022c6a85f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:48:09.181632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-3a38ab50-46fd-40a1-bf1a-e5a022c6a85f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:48:09.181632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:09.181632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:09.181632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:09.181632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:09.181632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:09.181632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:09.181632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:09.181632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:09.181632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:09.181632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:09.181632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:09.181632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:48:09.181632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:48:09.181632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:48:09.181632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:48:09.182559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:48:09.182559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:48:09.182559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:48:09.182559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:48:09.182559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:09.182559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:09.182559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:09.182559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:09.182559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:09.182559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:09.182559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:09.182559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:09.182559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:09.182559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:09.182559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:09.182559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:09.183455 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:09.183455 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:09.183455 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:09.183455 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:09.183455 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:48:09.183455 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:48:09.183455 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:48:09.183455 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:48:09.183455 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:48:09.183455 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:48:09.183455 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:48:09.183455 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:09.185747 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 397/792] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:48:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:09.186783 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38ab50-46fd-40a1-bf1a-e5a022c6a85f None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:09.197203 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943db983-1bf1-4112-899b-bd919f105fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:09.198173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943db983-1bf1-4112-899b-bd919f105fa2 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:09.198616 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943db983-1bf1-4112-899b-bd919f105fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:09.199024 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943db983-1bf1-4112-899b-bd919f105fa2 None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:09.200034 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943db983-1bf1-4112-899b-bd919f105fa2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:09.200538 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943db983-1bf1-4112-899b-bd919f105fa2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:09.202207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943db983-1bf1-4112-899b-bd919f105fa2 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:09.219777 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 396/793] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 3 09:48:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:09.220865 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943db983-1bf1-4112-899b-bd919f105fa2 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:09.292059 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38ab50-46fd-40a1-bf1a-e5a022c6a85f None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:09.324768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbc74d-e034-454f-b770-9911ee09f576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:09.325566 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbc74d-e034-454f-b770-9911ee09f576 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:09.325862 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbc74d-e034-454f-b770-9911ee09f576 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:09.326137 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbc74d-e034-454f-b770-9911ee09f576 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:09.331106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943db983-1bf1-4112-899b-bd919f105fa2 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:09.336287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbc74d-e034-454f-b770-9911ee09f576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:48:09.343914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-c3fbc74d-e034-454f-b770-9911ee09f576 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:48:09.343914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:09.343914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:09.343914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:09.343914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:09.343914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:09.343914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:09.343914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:09.343914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:09.343914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:09.343914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:09.343914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:09.343914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:48:09.343914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:48:09.343914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:48:09.343914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:48:09.345031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:48:09.345031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:48:09.345031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:48:09.345031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:48:09.345031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:09.345031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:09.345031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:09.345031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:09.345031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:09.345031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:09.345031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:09.345031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:09.345031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:09.345031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:09.345031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:09.345031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:09.346086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:09.346086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:09.346086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:09.346086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:09.346086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:48:09.346086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:48:09.346086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:48:09.346086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:48:09.346086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:48:09.346086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:48:09.346086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:48:09.346086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:09.346086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 398/794] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:48:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:09.346901 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbc74d-e034-454f-b770-9911ee09f576 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:09.374021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66d6ae-c3b3-41c2-a421-4fe27d05ff4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:09.375033 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66d6ae-c3b3-41c2-a421-4fe27d05ff4c None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:09.375456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66d6ae-c3b3-41c2-a421-4fe27d05ff4c None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:09.375864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66d6ae-c3b3-41c2-a421-4fe27d05ff4c None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:09.376746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66d6ae-c3b3-41c2-a421-4fe27d05ff4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:09.377245 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66d6ae-c3b3-41c2-a421-4fe27d05ff4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:09.378814 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66d6ae-c3b3-41c2-a421-4fe27d05ff4c None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:09.388427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 397/795] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:48:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:09.389493 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66d6ae-c3b3-41c2-a421-4fe27d05ff4c None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:09.448909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbc74d-e034-454f-b770-9911ee09f576 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:09.482077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cba70c-f5d8-4a9a-9680-cf52d2453fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:09.482639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cba70c-f5d8-4a9a-9680-cf52d2453fb0 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:09.482915 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cba70c-f5d8-4a9a-9680-cf52d2453fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:09.483183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cba70c-f5d8-4a9a-9680-cf52d2453fb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:09.492307 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66d6ae-c3b3-41c2-a421-4fe27d05ff4c None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:09.527356 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc95e7-c67b-4a5f-852b-2f8a19dd43ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:09.528023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc95e7-c67b-4a5f-852b-2f8a19dd43ef None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:09.528303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc95e7-c67b-4a5f-852b-2f8a19dd43ef None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:09.528575 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc95e7-c67b-4a5f-852b-2f8a19dd43ef None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:09.529625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc95e7-c67b-4a5f-852b-2f8a19dd43ef None admin] RBAC: Adding query filter params (name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:09.529945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc95e7-c67b-4a5f-852b-2f8a19dd43ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:09.531308 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc95e7-c67b-4a5f-852b-2f8a19dd43ef None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:09.543265 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 398/796] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:48:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:09.543923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc95e7-c67b-4a5f-852b-2f8a19dd43ef None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:09.561142 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cba70c-f5d8-4a9a-9680-cf52d2453fb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:09.563329 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cba70c-f5d8-4a9a-9680-cf52d2453fb0 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:09.653282 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc95e7-c67b-4a5f-852b-2f8a19dd43ef None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:09.675061 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 399/797] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:48:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:48:09.676270 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cba70c-f5d8-4a9a-9680-cf52d2453fb0 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:09.686311 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ca721-b556-43c7-85fb-0e2f74ed8e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:09.687222 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ca721-b556-43c7-85fb-0e2f74ed8e9d None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:09.687498 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ca721-b556-43c7-85fb-0e2f74ed8e9d None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:09.687766 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ca721-b556-43c7-85fb-0e2f74ed8e9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:09.698702 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ca721-b556-43c7-85fb-0e2f74ed8e9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:09.700146 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ca721-b556-43c7-85fb-0e2f74ed8e9d None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:09.717230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-4b5ca721-b556-43c7-85fb-0e2f74ed8e9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:09.717230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:09.717230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:09.717230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:09.717230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:09.717230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:09.717230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:09.717230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:09.717230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:09.717230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:09.717230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:09.717230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:09.717230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:09.717230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:09.717230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:09.718180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:09.718180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:09.718180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:09.718180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:09.718180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:09.718180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:09.718180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:09.718180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:09.718180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:09.718180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:09.718180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:09.718180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:09.718180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:09.718180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:09.718180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:09.718180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:09.718180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:09.719084 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:09.719084 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:09.719084 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:09.719084 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:09.722088 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 399/798] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:09.722856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ca721-b556-43c7-85fb-0e2f74ed8e9d None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:09.778270 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cba70c-f5d8-4a9a-9680-cf52d2453fb0 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:09.811458 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e0393-dfd4-47a3-a631-5be7774a6287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:09.812606 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e0393-dfd4-47a3-a631-5be7774a6287 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:09.813075 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e0393-dfd4-47a3-a631-5be7774a6287 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:09.813555 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e0393-dfd4-47a3-a631-5be7774a6287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:09.823746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ca721-b556-43c7-85fb-0e2f74ed8e9d None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:09.824462 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e0393-dfd4-47a3-a631-5be7774a6287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:09.826157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e0393-dfd4-47a3-a631-5be7774a6287 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:09.843897 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-519e0393-dfd4-47a3-a631-5be7774a6287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:09.843897 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:09.843897 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:09.843897 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:09.843897 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:09.843897 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:09.843897 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:09.843897 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:09.843897 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:09.843897 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:09.843897 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:09.843897 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:09.843897 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:09.843897 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:09.843897 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:09.844909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:09.844909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:09.844909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:09.844909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:09.844909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:09.844909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:09.844909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:09.844909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:09.844909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:09.844909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:09.844909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:09.844909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:09.844909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:09.844909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:09.844909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:09.844909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:09.844909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:09.845768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:09.845768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:09.845768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:09.845768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:09.848083 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 400/799] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:09.849077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e0393-dfd4-47a3-a631-5be7774a6287 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:09.865207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14044-21c6-4646-bfd9-96d5133b66c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:09.865749 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14044-21c6-4646-bfd9-96d5133b66c9 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:09.866075 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14044-21c6-4646-bfd9-96d5133b66c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:09.866349 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14044-21c6-4646-bfd9-96d5133b66c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:09.877163 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc14044-21c6-4646-bfd9-96d5133b66c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:09.878695 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc14044-21c6-4646-bfd9-96d5133b66c9 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:09.896136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-ffc14044-21c6-4646-bfd9-96d5133b66c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:09.896136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:09.896136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:09.896136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:09.896136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:09.896136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:09.896136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:09.896136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:09.896136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:09.896136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:09.896136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:09.896136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:09.896136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:09.896136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:09.896136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:09.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:09.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:09.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:09.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:09.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:09.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:09.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:09.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:09.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:09.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:09.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:09.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:09.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:09.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:09.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:09.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:09.897051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:09.897989 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:09.897989 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:09.897989 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:09.897989 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:09.897989 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 400/800] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:09.898764 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14044-21c6-4646-bfd9-96d5133b66c9 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:09.949961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e0393-dfd4-47a3-a631-5be7774a6287 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:09.983192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a82581-71a8-499e-b347-155f26aef1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:09.984218 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a82581-71a8-499e-b347-155f26aef1fb None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:09.984716 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a82581-71a8-499e-b347-155f26aef1fb None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:09.985173 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a82581-71a8-499e-b347-155f26aef1fb None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:09.986116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a82581-71a8-499e-b347-155f26aef1fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:09.986642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a82581-71a8-499e-b347-155f26aef1fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:09.988185 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a82581-71a8-499e-b347-155f26aef1fb None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:09.998388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14044-21c6-4646-bfd9-96d5133b66c9 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:10.000542 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 401/801] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:10.001574 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a82581-71a8-499e-b347-155f26aef1fb None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:10.041504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fce85-87dc-4c78-b0c7-010925331745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:10.042190 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fce85-87dc-4c78-b0c7-010925331745 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:10.042477 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fce85-87dc-4c78-b0c7-010925331745 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:10.042750 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fce85-87dc-4c78-b0c7-010925331745 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:10.043539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fce85-87dc-4c78-b0c7-010925331745 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:10.043844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fce85-87dc-4c78-b0c7-010925331745 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:10.045302 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fce85-87dc-4c78-b0c7-010925331745 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:10.063087 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 401/802] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:10.064061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fce85-87dc-4c78-b0c7-010925331745 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:10.108490 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a82581-71a8-499e-b347-155f26aef1fb None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:10.142642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08010faa-ab24-416e-a989-e1dd15d87179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:10.143678 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08010faa-ab24-416e-a989-e1dd15d87179 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:10.144148 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08010faa-ab24-416e-a989-e1dd15d87179 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:10.144606 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08010faa-ab24-416e-a989-e1dd15d87179 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:10.145507 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08010faa-ab24-416e-a989-e1dd15d87179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:10.146057 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08010faa-ab24-416e-a989-e1dd15d87179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:10.147611 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08010faa-ab24-416e-a989-e1dd15d87179 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:10.160197 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 402/803] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:10.161778 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08010faa-ab24-416e-a989-e1dd15d87179 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:10.163225 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fce85-87dc-4c78-b0c7-010925331745 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:10.199041 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40882a-6dc5-4c47-9661-209bb80959a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:10.199920 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40882a-6dc5-4c47-9661-209bb80959a9 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:10.200203 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40882a-6dc5-4c47-9661-209bb80959a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:10.200472 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40882a-6dc5-4c47-9661-209bb80959a9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:10.208162 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40882a-6dc5-4c47-9661-209bb80959a9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:10.209740 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40882a-6dc5-4c47-9661-209bb80959a9 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:10.224908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-4a40882a-6dc5-4c47-9661-209bb80959a9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 09:48:10.224908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:10.224908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:10.224908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:10.224908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:10.224908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:10.224908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:10.224908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:10.224908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:10.224908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:10.224908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:10.224908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:10.224908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:48:10.224908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:48:10.224908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:48:10.224908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:10.225908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:10.226852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:10.226852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:10.226852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:48:10.226852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:48:10.226852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:48:10.226852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:48:10.226852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:48:10.226852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:48:10.226852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 09:48:10.226852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:10.228771 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 402/804] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:48:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:10.229598 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40882a-6dc5-4c47-9661-209bb80959a9 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:10.266520 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08010faa-ab24-416e-a989-e1dd15d87179 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:10.305291 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632f03-7ac6-4b6f-910f-9703c6516f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:10.306428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632f03-7ac6-4b6f-910f-9703c6516f69 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:10.306914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632f03-7ac6-4b6f-910f-9703c6516f69 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:10.307385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632f03-7ac6-4b6f-910f-9703c6516f69 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:10.314785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31632f03-7ac6-4b6f-910f-9703c6516f69 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:10.316406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31632f03-7ac6-4b6f-910f-9703c6516f69 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:10.331531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-31632f03-7ac6-4b6f-910f-9703c6516f69 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 09:48:10.331531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:10.331531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:10.331531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:10.331531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:10.331531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:10.331531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:10.331531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:10.331531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:10.331531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:10.331531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:10.331531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:10.331531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:48:10.331531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:48:10.331531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:48:10.331531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:10.332477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:10.333448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:10.333448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:10.333448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:48:10.333448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:48:10.333448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:48:10.333448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:48:10.333448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:48:10.333448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:48:10.333448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 09:48:10.333448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:10.334024 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40882a-6dc5-4c47-9661-209bb80959a9 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:10.335029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 403/805] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 3 09:48:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:10.336382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cda7f-c7d5-4c6b-90bc-5c9bce2262d5 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:10.336665 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cda7f-c7d5-4c6b-90bc-5c9bce2262d5 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:10.336939 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cda7f-c7d5-4c6b-90bc-5c9bce2262d5 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:10.338243 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 404/806] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:10.338930 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cda7f-c7d5-4c6b-90bc-5c9bce2262d5 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:10.369194 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436ffd6-dfdd-4acb-9297-a093973c557f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:10.370625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436ffd6-dfdd-4acb-9297-a093973c557f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:10.371247 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436ffd6-dfdd-4acb-9297-a093973c557f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:10.372034 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436ffd6-dfdd-4acb-9297-a093973c557f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:10.380066 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436ffd6-dfdd-4acb-9297-a093973c557f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:10.381513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436ffd6-dfdd-4acb-9297-a093973c557f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:10.395947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-3436ffd6-dfdd-4acb-9297-a093973c557f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:10.395947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:10.395947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:10.395947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:10.395947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:10.395947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:10.395947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:10.395947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:10.395947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:10.395947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:10.395947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:10.395947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:10.395947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:48:10.395947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:48:10.395947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:48:10.396847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:48:10.396847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:10.396847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:10.396847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:10.396847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:10.396847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:10.396847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:10.396847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:10.396847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:10.396847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:10.396847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:10.396847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:10.396847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:10.396847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:10.396847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:10.396847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:10.396847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:10.397721 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:48:10.397721 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:48:10.397721 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:48:10.397721 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:48:10.397721 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:48:10.397721 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:48:10.397721 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:10.397721 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:10.402161 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 403/807] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:10.403011 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436ffd6-dfdd-4acb-9297-a093973c557f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:10.440777 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cda7f-c7d5-4c6b-90bc-5c9bce2262d5 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:10.473505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9cbee-9585-4d17-8a8c-f849da607547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:10.474194 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9cbee-9585-4d17-8a8c-f849da607547 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:10.474472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9cbee-9585-4d17-8a8c-f849da607547 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:10.474741 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9cbee-9585-4d17-8a8c-f849da607547 None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:10.475567 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9cbee-9585-4d17-8a8c-f849da607547 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:10.475868 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9cbee-9585-4d17-8a8c-f849da607547 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:10.477574 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9cbee-9585-4d17-8a8c-f849da607547 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:10.499161 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 405/808] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 3 09:48:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:10.499161 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4a13d-535c-49b7-9e74-1849fca5791f None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:10.499161 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4a13d-535c-49b7-9e74-1849fca5791f None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:10.499161 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4a13d-535c-49b7-9e74-1849fca5791f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:10.502148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436ffd6-dfdd-4acb-9297-a093973c557f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:10.514436 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-2da4a13d-535c-49b7-9e74-1849fca5791f None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:10.515622 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-2da4a13d-535c-49b7-9e74-1849fca5791f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:10.537825 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fa596-4423-4863-a5b7-2beffad45292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:10.538868 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fa596-4423-4863-a5b7-2beffad45292 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:10.539157 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fa596-4423-4863-a5b7-2beffad45292 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:10.539530 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fa596-4423-4863-a5b7-2beffad45292 None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:10.540395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fa596-4423-4863-a5b7-2beffad45292 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:10.540704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fa596-4423-4863-a5b7-2beffad45292 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:10.542210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fa596-4423-4863-a5b7-2beffad45292 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:10.562886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 404/809] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 3 09:48:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:10.563671 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fa596-4423-4863-a5b7-2beffad45292 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:10.588912 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 406/810] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:10.589845 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4a13d-535c-49b7-9e74-1849fca5791f None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:10.668658 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fa596-4423-4863-a5b7-2beffad45292 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:10.691743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4a13d-535c-49b7-9e74-1849fca5791f None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:10.701701 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d04cb3-bff5-4d84-bada-2966df3ce93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:10.702386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d04cb3-bff5-4d84-bada-2966df3ce93f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:10.702661 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d04cb3-bff5-4d84-bada-2966df3ce93f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:10.702932 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d04cb3-bff5-4d84-bada-2966df3ce93f None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:10.703707 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d04cb3-bff5-4d84-bada-2966df3ce93f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:10.704009 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d04cb3-bff5-4d84-bada-2966df3ce93f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:10.705431 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d04cb3-bff5-4d84-bada-2966df3ce93f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:10.717049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 405/811] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:48:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:10.717888 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d04cb3-bff5-4d84-bada-2966df3ce93f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:10.724632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0e622-dbeb-481d-b3c3-d2914507b8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:10.725424 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0e622-dbeb-481d-b3c3-d2914507b8b5 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:10.725694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0e622-dbeb-481d-b3c3-d2914507b8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:10.726042 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0e622-dbeb-481d-b3c3-d2914507b8b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:10.736039 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0e622-dbeb-481d-b3c3-d2914507b8b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:10.737472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0e622-dbeb-481d-b3c3-d2914507b8b5 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:10.754033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-bdf0e622-dbeb-481d-b3c3-d2914507b8b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:10.754033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:10.754033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:10.754033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:10.754033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:10.754033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:10.754033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:10.754033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:10.754033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:10.754033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:10.754033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:10.754033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:10.754033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:10.754033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:10.754033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:10.755117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:10.755117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:10.755117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:10.755117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:10.755117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:10.755117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:10.755117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:10.755117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:10.755117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:10.755117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:10.755117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:10.755117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:10.755117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:10.755117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:10.755117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:10.755117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:10.755117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:10.756031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:10.756031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:10.756031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:10.756031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:10.756031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 407/812] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:10.756031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0e622-dbeb-481d-b3c3-d2914507b8b5 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:10.813283 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d04cb3-bff5-4d84-bada-2966df3ce93f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:10.846013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0433d3-e528-42cb-a5fc-1871bcd971e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:10.846788 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0433d3-e528-42cb-a5fc-1871bcd971e3 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:10.847037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0433d3-e528-42cb-a5fc-1871bcd971e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:10.847319 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0433d3-e528-42cb-a5fc-1871bcd971e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:10.849173 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0e622-dbeb-481d-b3c3-d2914507b8b5 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:10.857359 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0433d3-e528-42cb-a5fc-1871bcd971e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:10.858801 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0433d3-e528-42cb-a5fc-1871bcd971e3 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:10.874933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-4b0433d3-e528-42cb-a5fc-1871bcd971e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:10.874933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:10.874933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:10.874933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:10.874933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:10.874933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:10.874933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:10.874933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:10.874933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:10.874933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:10.874933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:10.874933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:10.874933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:10.874933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:10.874933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:10.875824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:10.875824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:10.875824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:10.875824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:10.875824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:10.875824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:10.875824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:10.875824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:10.875824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:10.875824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:10.875824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:10.875824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:10.875824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:10.875824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:10.875824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:10.875824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:10.875824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:10.876704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:10.876704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:10.876704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:10.876704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:10.876704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 406/813] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:10.877259 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af328f9f-b2a4-4295-8074-e616be54b8b4 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:10.877507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af328f9f-b2a4-4295-8074-e616be54b8b4 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:10.877775 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af328f9f-b2a4-4295-8074-e616be54b8b4 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:10.879126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 407/814] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:10.879661 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af328f9f-b2a4-4295-8074-e616be54b8b4 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:10.885817 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50798a39-e9b1-4ba0-960e-279c00490a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:10.886629 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50798a39-e9b1-4ba0-960e-279c00490a75 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:10.886908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50798a39-e9b1-4ba0-960e-279c00490a75 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:10.887177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50798a39-e9b1-4ba0-960e-279c00490a75 None admin] PATH_INFO: `/v3/services/network` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:10.887835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50798a39-e9b1-4ba0-960e-279c00490a75 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:10.889193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50798a39-e9b1-4ba0-960e-279c00490a75 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:10.901179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-50798a39-e9b1-4ba0-960e-279c00490a75 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 09:48:10.901179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:10.901179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:10.901179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:10.901179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:10.901179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:10.901179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:10.901179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:10.901179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 09:48:10.901179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:10.901179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:10.901179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:10.901179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:10.901179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:10.901179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:10.901179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:10.901179 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:10.902195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:10.902195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:10.902195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:10.902195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:10.902195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:10.902195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:10.902195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:10.902195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:10.902195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:10.902195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:10.902195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:10.902195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:10.902195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:10.902195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:10.902195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:10.902195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:10.903024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:10.903024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:10.903024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:10.903024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:10.903024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:10.903024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:10.903024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:10.903024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:10.903024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:10.903024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:10.903024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:10.903024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:10.903024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 09:48:10.903024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:10.903959 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 408/815] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:10 2022] GET /identity/v3/services/network => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:10.904136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50798a39-e9b1-4ba0-960e-279c00490a75 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:10.983886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af328f9f-b2a4-4295-8074-e616be54b8b4 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:11.000645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50798a39-e9b1-4ba0-960e-279c00490a75 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:11.017285 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f37eb3-96bd-4c2c-9f4b-bd1460d67bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:11.017970 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f37eb3-96bd-4c2c-9f4b-bd1460d67bf6 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:11.018249 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f37eb3-96bd-4c2c-9f4b-bd1460d67bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:11.018522 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f37eb3-96bd-4c2c-9f4b-bd1460d67bf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:11.019355 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f37eb3-96bd-4c2c-9f4b-bd1460d67bf6 None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=efb008cfc6424998917da60d72689f55) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:11.019662 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f37eb3-96bd-4c2c-9f4b-bd1460d67bf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:11.021086 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f37eb3-96bd-4c2c-9f4b-bd1460d67bf6 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:11.026911 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 408/816] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:48:10 2022] GET /identity/v3/role_assignments?user.id=efb008cfc6424998917da60d72689f55&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=52d3ad3e32c741938997691c9a909b81 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:11.027513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f37eb3-96bd-4c2c-9f4b-bd1460d67bf6 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:11.033642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21149d6-3f28-466e-93bb-8604bce6b9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:11.034353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21149d6-3f28-466e-93bb-8604bce6b9f0 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:11.034634 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21149d6-3f28-466e-93bb-8604bce6b9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:11.034901 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21149d6-3f28-466e-93bb-8604bce6b9f0 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:11.035622 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21149d6-3f28-466e-93bb-8604bce6b9f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:11.035921 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21149d6-3f28-466e-93bb-8604bce6b9f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:11.037323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21149d6-3f28-466e-93bb-8604bce6b9f0 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:11.052012 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 409/817] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:11.053489 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccbb65-dcc0-47a0-b11a-6a59e58a6384 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:11.053781 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccbb65-dcc0-47a0-b11a-6a59e58a6384 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:11.054103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccbb65-dcc0-47a0-b11a-6a59e58a6384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:11.071374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-daccbb65-dcc0-47a0-b11a-6a59e58a6384 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:11.072495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-daccbb65-dcc0-47a0-b11a-6a59e58a6384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:11.135618 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f37eb3-96bd-4c2c-9f4b-bd1460d67bf6 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:11.143042 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 410/818] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:11.144191 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccbb65-dcc0-47a0-b11a-6a59e58a6384 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:11.178855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83414b48-884f-4db4-bde0-fad838d171b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:11.179670 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83414b48-884f-4db4-bde0-fad838d171b6 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:11.179980 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83414b48-884f-4db4-bde0-fad838d171b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:11.180251 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83414b48-884f-4db4-bde0-fad838d171b6 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:11.180996 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83414b48-884f-4db4-bde0-fad838d171b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:11.181300 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83414b48-884f-4db4-bde0-fad838d171b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:11.182750 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83414b48-884f-4db4-bde0-fad838d171b6 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:11.200134 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 409/819] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:11.200134 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83414b48-884f-4db4-bde0-fad838d171b6 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:11.248325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccbb65-dcc0-47a0-b11a-6a59e58a6384 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:11.281539 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d28a1-b70d-41e1-b345-d201f2412ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:11.282284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d28a1-b70d-41e1-b345-d201f2412ae5 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:11.282564 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d28a1-b70d-41e1-b345-d201f2412ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:11.282833 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d28a1-b70d-41e1-b345-d201f2412ae5 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:11.283546 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d28a1-b70d-41e1-b345-d201f2412ae5 None admin] RBAC: Adding query filter params (name=network) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:11.283847 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d28a1-b70d-41e1-b345-d201f2412ae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:11.286006 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d28a1-b70d-41e1-b345-d201f2412ae5 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:11.297471 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 411/820] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 3 09:48:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:11.297471 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d28a1-b70d-41e1-b345-d201f2412ae5 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:11.311557 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83414b48-884f-4db4-bde0-fad838d171b6 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:11.349183 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f786f-1c1a-4291-aa2e-846c0fec1edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:11.349924 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f786f-1c1a-4291-aa2e-846c0fec1edd None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:11.350198 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f786f-1c1a-4291-aa2e-846c0fec1edd None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:11.350461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f786f-1c1a-4291-aa2e-846c0fec1edd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:11.357221 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f786f-1c1a-4291-aa2e-846c0fec1edd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:11.358679 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f786f-1c1a-4291-aa2e-846c0fec1edd None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:11.372031 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-c79f786f-1c1a-4291-aa2e-846c0fec1edd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:11.372031 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:11.372031 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:11.372031 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:11.372031 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:11.372031 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:11.372031 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:11.372031 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:11.372031 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:11.372031 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:11.372031 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:11.372031 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:11.372031 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:48:11.372031 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:48:11.372031 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:48:11.372971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:48:11.372971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:11.372971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:11.372971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:11.372971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:11.372971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:11.372971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:11.372971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:11.372971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:11.372971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:11.372971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:11.372971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:11.372971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:11.372971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:11.372971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:11.372971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:11.372971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:11.374280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:48:11.374280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:48:11.374280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:48:11.374280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:48:11.374280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:48:11.374280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:48:11.374280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:11.374280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:11.376125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 410/821] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:11.376939 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f786f-1c1a-4291-aa2e-846c0fec1edd None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:11.396245 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d28a1-b70d-41e1-b345-d201f2412ae5 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:11.428778 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68095cb-63e0-42d1-ab3f-f7744d84dabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:11.430064 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68095cb-63e0-42d1-ab3f-f7744d84dabe None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:11.430347 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68095cb-63e0-42d1-ab3f-f7744d84dabe None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:11.430617 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68095cb-63e0-42d1-ab3f-f7744d84dabe None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:11.431267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68095cb-63e0-42d1-ab3f-f7744d84dabe None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:11.432617 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68095cb-63e0-42d1-ab3f-f7744d84dabe None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:11.444841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-d68095cb-63e0-42d1-ab3f-f7744d84dabe None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 09:48:11.444841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:11.444841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:11.444841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:11.444841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:11.444841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:11.444841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:11.444841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:11.444841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 09:48:11.444841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:11.444841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:11.444841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:11.444841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:11.444841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:11.444841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:11.444841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:11.445814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:11.445814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:11.445814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:11.445814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:11.445814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:11.445814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:11.445814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:11.445814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:11.445814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:11.445814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:11.445814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:11.445814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:11.445814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:11.445814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:11.445814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:11.445814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:11.451694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:11.451694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:11.451694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:11.451694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:11.451694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:11.451694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:11.451694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:11.451694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:11.451694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:11.451694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:11.451694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:11.451694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:11.451694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:11.451694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 09:48:11.451694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:11.451694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 412/822] 10.222.0.55 () {56 vars in 1129 bytes} [Tue May 3 09:48:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:11.452535 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68095cb-63e0-42d1-ab3f-f7744d84dabe None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:11.484053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f786f-1c1a-4291-aa2e-846c0fec1edd None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:11.521902 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132ddf7-abad-40e4-93a5-912dfc122b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:11.522706 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132ddf7-abad-40e4-93a5-912dfc122b8f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:11.523029 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132ddf7-abad-40e4-93a5-912dfc122b8f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:11.523304 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132ddf7-abad-40e4-93a5-912dfc122b8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:11.529880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132ddf7-abad-40e4-93a5-912dfc122b8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:11.531318 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132ddf7-abad-40e4-93a5-912dfc122b8f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:11.545100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-f132ddf7-abad-40e4-93a5-912dfc122b8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:11.545100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:11.545100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:11.545100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:11.545100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:11.545100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:11.545100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:11.545100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:11.545100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:11.545100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:11.545100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:11.545100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:11.545100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:48:11.545100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:48:11.545100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:48:11.546212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:48:11.546212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:11.546212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:11.546212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:11.546212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:11.546212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:11.546212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:11.546212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:11.546212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:11.546212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:11.546212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:11.546212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:11.546212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:11.546212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:11.546212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:11.546212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:11.546212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:11.547102 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:48:11.547102 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:48:11.547102 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:48:11.547102 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:48:11.547102 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:48:11.547102 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:48:11.547102 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:11.547102 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:11.547102 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 411/823] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:11.547102 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132ddf7-abad-40e4-93a5-912dfc122b8f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:11.556037 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68095cb-63e0-42d1-ab3f-f7744d84dabe None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:11.590538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03573b5-ebe9-4993-9f99-44dd2da663ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:11.591203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03573b5-ebe9-4993-9f99-44dd2da663ba None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:11.591481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03573b5-ebe9-4993-9f99-44dd2da663ba None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:11.591747 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03573b5-ebe9-4993-9f99-44dd2da663ba None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:11.592454 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03573b5-ebe9-4993-9f99-44dd2da663ba None admin] RBAC: Adding query filter params (type=network) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:11.592758 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03573b5-ebe9-4993-9f99-44dd2da663ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:11.594160 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03573b5-ebe9-4993-9f99-44dd2da663ba None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:11.600463 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 413/824] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 3 09:48:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:11.600463 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03573b5-ebe9-4993-9f99-44dd2da663ba None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:11.648822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132ddf7-abad-40e4-93a5-912dfc122b8f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:11.681737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cf9c7-131b-47b6-9b54-d8d0a4034a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:11.682418 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cf9c7-131b-47b6-9b54-d8d0a4034a4d None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:11.682696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cf9c7-131b-47b6-9b54-d8d0a4034a4d None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:11.682966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cf9c7-131b-47b6-9b54-d8d0a4034a4d None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:11.683745 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cf9c7-131b-47b6-9b54-d8d0a4034a4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:11.684036 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cf9c7-131b-47b6-9b54-d8d0a4034a4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:11.685508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cf9c7-131b-47b6-9b54-d8d0a4034a4d None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:11.695675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03573b5-ebe9-4993-9f99-44dd2da663ba None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:11.701767 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 412/825] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:48:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:11.701767 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cf9c7-131b-47b6-9b54-d8d0a4034a4d None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:11.728105 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fab66-a5df-48e2-93e9-076c5239bbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:11.728772 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fab66-a5df-48e2-93e9-076c5239bbbc None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:11.729067 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fab66-a5df-48e2-93e9-076c5239bbbc None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:11.729324 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fab66-a5df-48e2-93e9-076c5239bbbc None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:11.730068 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fab66-a5df-48e2-93e9-076c5239bbbc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:11.730373 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fab66-a5df-48e2-93e9-076c5239bbbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:11.731725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fab66-a5df-48e2-93e9-076c5239bbbc None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:11.736433 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 414/826] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 3 09:48:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:11.737262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fab66-a5df-48e2-93e9-076c5239bbbc None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:11.800949 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cf9c7-131b-47b6-9b54-d8d0a4034a4d None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:11.832905 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726cb64-d863-4667-95a1-2dd65d0ca97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:11.833355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fab66-a5df-48e2-93e9-076c5239bbbc None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:11.833561 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726cb64-d863-4667-95a1-2dd65d0ca97d None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:11.833853 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726cb64-d863-4667-95a1-2dd65d0ca97d None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:11.834122 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726cb64-d863-4667-95a1-2dd65d0ca97d None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:11.834891 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726cb64-d863-4667-95a1-2dd65d0ca97d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:11.835193 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726cb64-d863-4667-95a1-2dd65d0ca97d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:11.836669 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726cb64-d863-4667-95a1-2dd65d0ca97d None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:11.848480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 413/827] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:48:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:11.849573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726cb64-d863-4667-95a1-2dd65d0ca97d None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:11.866085 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f025e4-58b7-4c04-9fc0-bc3780595d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:11.866736 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f025e4-58b7-4c04-9fc0-bc3780595d5b None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:11.867008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f025e4-58b7-4c04-9fc0-bc3780595d5b None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:11.867282 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f025e4-58b7-4c04-9fc0-bc3780595d5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:11.868030 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f025e4-58b7-4c04-9fc0-bc3780595d5b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:11.869407 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f025e4-58b7-4c04-9fc0-bc3780595d5b None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:11.893945 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 415/828] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 3 09:48:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:48:11.894893 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f025e4-58b7-4c04-9fc0-bc3780595d5b None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:11.972039 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726cb64-d863-4667-95a1-2dd65d0ca97d None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:12.009572 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f025e4-58b7-4c04-9fc0-bc3780595d5b None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:12.013021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa680fdb-8d32-4d93-bd6e-7cd8b0dd5378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:12.014317 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa680fdb-8d32-4d93-bd6e-7cd8b0dd5378 None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:12.014824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa680fdb-8d32-4d93-bd6e-7cd8b0dd5378 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:12.015313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa680fdb-8d32-4d93-bd6e-7cd8b0dd5378 None admin] PATH_INFO: `/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/73dfc1b485d647f1ae59a405c978599f/roles/52d3ad3e32c741938997691c9a909b81` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:12.017708 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa680fdb-8d32-4d93-bd6e-7cd8b0dd5378 None admin] RBAC: Authorizing `identity:create_grant(project_id=f395f4842c39422d962dbddc4cf2897a, user_id=73dfc1b485d647f1ae59a405c978599f, role_id=52d3ad3e32c741938997691c9a909b81)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:12.019482 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa680fdb-8d32-4d93-bd6e-7cd8b0dd5378 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:12.042165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 414/829] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:48:11 2022] PUT /identity/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/73dfc1b485d647f1ae59a405c978599f/roles/52d3ad3e32c741938997691c9a909b81 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:48:12.043582 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa680fdb-8d32-4d93-bd6e-7cd8b0dd5378 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:12.050297 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525d4c0-3be9-479c-bc31-4f6e636f11fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:12.050985 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525d4c0-3be9-479c-bc31-4f6e636f11fe None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:12.051261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525d4c0-3be9-479c-bc31-4f6e636f11fe None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:12.051529 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525d4c0-3be9-479c-bc31-4f6e636f11fe None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:12.052250 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525d4c0-3be9-479c-bc31-4f6e636f11fe None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:12.052553 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525d4c0-3be9-479c-bc31-4f6e636f11fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:12.061933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525d4c0-3be9-479c-bc31-4f6e636f11fe None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:12.061933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 416/830] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 3 09:48:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:12.071275 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525d4c0-3be9-479c-bc31-4f6e636f11fe None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:12.207470 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525d4c0-3be9-479c-bc31-4f6e636f11fe None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:12.235404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa680fdb-8d32-4d93-bd6e-7cd8b0dd5378 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:12.253401 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68cd59-eaaf-4f20-96ae-2399a86bf65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:12.257724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68cd59-eaaf-4f20-96ae-2399a86bf65c None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:12.258047 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68cd59-eaaf-4f20-96ae-2399a86bf65c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:12.261817 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68cd59-eaaf-4f20-96ae-2399a86bf65c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:12.261817 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68cd59-eaaf-4f20-96ae-2399a86bf65c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:12.261817 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68cd59-eaaf-4f20-96ae-2399a86bf65c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:12.290112 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 417/831] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 3 09:48:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:48:12.297645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a5a84-374e-42c2-95b3-1549f3ff0b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:12.298704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a5a84-374e-42c2-95b3-1549f3ff0b14 None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:12.298980 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a5a84-374e-42c2-95b3-1549f3ff0b14 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:12.299246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a5a84-374e-42c2-95b3-1549f3ff0b14 None admin] PATH_INFO: `/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/62b336ab0cfd4bfd9ec498dcd940332f/roles/779b01e1e2534bfba9971e7000b7c628` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:12.316228 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a5a84-374e-42c2-95b3-1549f3ff0b14 None admin] RBAC: Authorizing `identity:create_grant(project_id=f395f4842c39422d962dbddc4cf2897a, user_id=62b336ab0cfd4bfd9ec498dcd940332f, role_id=779b01e1e2534bfba9971e7000b7c628)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:12.317724 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a5a84-374e-42c2-95b3-1549f3ff0b14 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:12.334513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 415/832] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:48:12 2022] PUT /identity/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/62b336ab0cfd4bfd9ec498dcd940332f/roles/779b01e1e2534bfba9971e7000b7c628 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:48:13.375395 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4256ea-cb13-49b1-b95c-0d871e529368 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:13.375914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4256ea-cb13-49b1-b95c-0d871e529368 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:13.375914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4256ea-cb13-49b1-b95c-0d871e529368 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:13.377543 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 418/833] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:13.382878 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0e7a2-0865-43de-891a-4bb6843e78ee None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:13.383634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0e7a2-0865-43de-891a-4bb6843e78ee None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:13.383710 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0e7a2-0865-43de-891a-4bb6843e78ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:13.400509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-35c0e7a2-0865-43de-891a-4bb6843e78ee None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:13.401670 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-35c0e7a2-0865-43de-891a-4bb6843e78ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:13.466085 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 416/834] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:13.488212 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4256ea-cb13-49b1-b95c-0d871e529368 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:13.588233 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4256ea-cb13-49b1-b95c-0d871e529368 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:13.620109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39955d6a-dbf5-48d7-b46d-026a65da5f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:13.620921 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39955d6a-dbf5-48d7-b46d-026a65da5f2d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:13.621199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39955d6a-dbf5-48d7-b46d-026a65da5f2d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:13.621468 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39955d6a-dbf5-48d7-b46d-026a65da5f2d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:13.622152 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39955d6a-dbf5-48d7-b46d-026a65da5f2d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:13.623506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39955d6a-dbf5-48d7-b46d-026a65da5f2d None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:13.636126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-39955d6a-dbf5-48d7-b46d-026a65da5f2d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 09:48:13.636126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:13.636126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:13.636126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:13.636126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:13.636126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:13.636126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:13.636126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:13.636126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 09:48:13.636126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:13.636126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:13.636126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:13.636126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:13.636126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:13.636126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:13.636126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:13.638325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:13.638325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:13.638325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:13.638325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:13.638325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:13.638325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:13.638325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:13.638325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:13.638325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:13.638325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:13.638325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:13.638325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:13.638325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:13.638325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:13.638325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:13.638325 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:13.642733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:13.642733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:13.642733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:13.642733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:13.642733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:13.642733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:13.642733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:13.642733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:13.642733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:13.642733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:13.642733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:13.642733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:13.642733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:13.642733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 09:48:13.642733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:13.642733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 419/835] 10.222.0.55 () {56 vars in 1132 bytes} [Tue May 3 09:48:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:13.644677 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0e7a2-0865-43de-891a-4bb6843e78ee None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:13.736465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0e7a2-0865-43de-891a-4bb6843e78ee None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:13.769415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee64804-b131-487e-91a5-c62de06b96b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:13.770117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee64804-b131-487e-91a5-c62de06b96b1 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:13.770395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee64804-b131-487e-91a5-c62de06b96b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:13.770668 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee64804-b131-487e-91a5-c62de06b96b1 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:13.771372 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee64804-b131-487e-91a5-c62de06b96b1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:13.771672 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee64804-b131-487e-91a5-c62de06b96b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:13.773142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee64804-b131-487e-91a5-c62de06b96b1 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:13.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 417/836] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 3 09:48:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:13.783289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39955d6a-dbf5-48d7-b46d-026a65da5f2d None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:13.884126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39955d6a-dbf5-48d7-b46d-026a65da5f2d None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:13.919035 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838c1d2-0171-412b-b52d-2ee3a946e7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:13.919703 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838c1d2-0171-412b-b52d-2ee3a946e7d1 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:13.919984 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838c1d2-0171-412b-b52d-2ee3a946e7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:13.920257 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838c1d2-0171-412b-b52d-2ee3a946e7d1 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:13.921026 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838c1d2-0171-412b-b52d-2ee3a946e7d1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:13.921334 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838c1d2-0171-412b-b52d-2ee3a946e7d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:13.922777 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838c1d2-0171-412b-b52d-2ee3a946e7d1 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:13.927606 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 420/837] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 3 09:48:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:14.427356 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c95cf-ce6b-445d-b0e8-9c2358053e5c None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:14.427891 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c95cf-ce6b-445d-b0e8-9c2358053e5c None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:14.427891 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c95cf-ce6b-445d-b0e8-9c2358053e5c None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:14.429763 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 418/838] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:14.435968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a80f9-c139-4888-9d1c-2e478f8a56c5 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:14.436495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a80f9-c139-4888-9d1c-2e478f8a56c5 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:14.436571 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a80f9-c139-4888-9d1c-2e478f8a56c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:14.455388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-c81a80f9-c139-4888-9d1c-2e478f8a56c5 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:14.456580 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-c81a80f9-c139-4888-9d1c-2e478f8a56c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:14.528064 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 421/839] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:48:14.551532 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c95cf-ce6b-445d-b0e8-9c2358053e5c None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:14.607310 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ab1f3-78db-441a-b342-dc09df9925ff None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:14.607643 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ab1f3-78db-441a-b342-dc09df9925ff None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:14.607863 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ab1f3-78db-441a-b342-dc09df9925ff None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:14.609459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 422/840] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:48:14.614813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714e465-c258-4772-be07-f4bc798f60ca None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:14.615200 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714e465-c258-4772-be07-f4bc798f60ca None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:14.615567 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714e465-c258-4772-be07-f4bc798f60ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:14.641653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-f714e465-c258-4772-be07-f4bc798f60ca None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:14.643529 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-f714e465-c258-4772-be07-f4bc798f60ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:14.652351 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c95cf-ce6b-445d-b0e8-9c2358053e5c None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:14.685130 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2d891-cc14-49ae-b42c-b4c0b599bd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:14.685965 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2d891-cc14-49ae-b42c-b4c0b599bd72 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:14.686248 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2d891-cc14-49ae-b42c-b4c0b599bd72 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:14.686520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2d891-cc14-49ae-b42c-b4c0b599bd72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:14.696961 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2d891-cc14-49ae-b42c-b4c0b599bd72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:48:14.704468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-44e2d891-cc14-49ae-b42c-b4c0b599bd72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:48:14.704468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:14.704468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:14.704468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:14.704468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:14.704468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:14.704468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:14.704468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:14.704468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:14.704468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:14.704468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:14.704468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:14.704468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:48:14.704468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:48:14.704468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:48:14.704468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:48:14.705412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:48:14.705412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:48:14.705412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:48:14.705412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:48:14.705412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:14.705412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:14.705412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:14.705412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:14.705412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:14.705412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:14.705412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:14.705412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:14.705412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:14.705412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:14.705412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:14.705412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:14.706278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:14.706278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:14.706278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:14.706278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:14.706278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:48:14.706278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:48:14.706278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:48:14.706278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:48:14.706278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:48:14.706278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:48:14.706278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:48:14.706278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:14.706278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 419/841] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:48:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:14.706988 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef01c8c-debf-45b5-9515-eea5a1ca447e None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:14.707531 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef01c8c-debf-45b5-9515-eea5a1ca447e None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:14.707531 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef01c8c-debf-45b5-9515-eea5a1ca447e None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:14.708861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 420/842] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:14.713996 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef01c8c-debf-45b5-9515-eea5a1ca447e None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:14.719725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 423/843] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:14.723715 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb147d0-701b-429e-a7fe-2f5b788a509f None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:14.724211 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb147d0-701b-429e-a7fe-2f5b788a509f None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:14.724674 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb147d0-701b-429e-a7fe-2f5b788a509f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:14.746011 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-2fb147d0-701b-429e-a7fe-2f5b788a509f None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:14.748272 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-2fb147d0-701b-429e-a7fe-2f5b788a509f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:14.813727 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 424/844] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:14.814788 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb147d0-701b-429e-a7fe-2f5b788a509f None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:14.828257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef01c8c-debf-45b5-9515-eea5a1ca447e None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:14.867933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7308b3-3814-43fc-b9ab-cf613127149f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:14.869007 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7308b3-3814-43fc-b9ab-cf613127149f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:14.869410 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7308b3-3814-43fc-b9ab-cf613127149f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:14.870164 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7308b3-3814-43fc-b9ab-cf613127149f None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:14.871321 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7308b3-3814-43fc-b9ab-cf613127149f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:14.871795 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7308b3-3814-43fc-b9ab-cf613127149f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:14.874062 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7308b3-3814-43fc-b9ab-cf613127149f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:14.889667 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 421/845] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:48:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:14.890765 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7308b3-3814-43fc-b9ab-cf613127149f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:14.914532 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb147d0-701b-429e-a7fe-2f5b788a509f None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:14.961592 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7ed23-d03c-4268-aff1-1bdf5bcc546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:14.962415 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7ed23-d03c-4268-aff1-1bdf5bcc546a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:14.962656 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7ed23-d03c-4268-aff1-1bdf5bcc546a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:14.962949 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7ed23-d03c-4268-aff1-1bdf5bcc546a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:14.963586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7ed23-d03c-4268-aff1-1bdf5bcc546a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:14.965379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7ed23-d03c-4268-aff1-1bdf5bcc546a None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:14.979889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-a9a7ed23-d03c-4268-aff1-1bdf5bcc546a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 09:48:14.979889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:14.979889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:14.979889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:14.979889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:14.979889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:14.979889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:14.979889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:14.979889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 09:48:14.979889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:14.979889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:14.979889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:14.979889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:14.979889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:14.979889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:14.979889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:14.979889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:14.980898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:14.980898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:14.980898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:14.980898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:14.980898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:14.980898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:14.980898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:14.980898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:14.980898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:14.980898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:14.980898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:14.980898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:14.980898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:14.980898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:14.980898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:14.980898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:14.981730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:14.981730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:14.981730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:14.981730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:14.981730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:14.981730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:14.981730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:14.981730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:14.981730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:14.981730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:14.981730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:14.981730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:14.981730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 09:48:14.981730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:14.981730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 425/846] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:48:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:14.982562 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7ed23-d03c-4268-aff1-1bdf5bcc546a None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:14.994077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7308b3-3814-43fc-b9ab-cf613127149f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:15.028345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac508e-d4e2-4d05-b30d-b1e84d2bb852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:15.029244 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac508e-d4e2-4d05-b30d-b1e84d2bb852 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:15.029522 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac508e-d4e2-4d05-b30d-b1e84d2bb852 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:15.030074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac508e-d4e2-4d05-b30d-b1e84d2bb852 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:15.040476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac508e-d4e2-4d05-b30d-b1e84d2bb852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:48:15.048320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-55ac508e-d4e2-4d05-b30d-b1e84d2bb852 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:48:15.048320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:15.048320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:15.048320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:15.048320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:15.048320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:15.048320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:15.048320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:15.048320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:15.048320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:15.048320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:15.048320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:15.048320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:48:15.048320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:48:15.048320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:48:15.048320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:48:15.049405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:48:15.049405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:48:15.049405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:48:15.049405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:48:15.049405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:15.049405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:15.049405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:15.049405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:15.049405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:15.049405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:15.049405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:15.049405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:15.049405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:15.049405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:15.049405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:15.049405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:15.050313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:15.050313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:15.050313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:15.050313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:15.050313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:48:15.050313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:48:15.050313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:48:15.050313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:48:15.050313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:48:15.050313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:48:15.050313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:48:15.050313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:15.054148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 422/847] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:48:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:15.055749 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac508e-d4e2-4d05-b30d-b1e84d2bb852 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:15.098505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7ed23-d03c-4268-aff1-1bdf5bcc546a None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:15.129885 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bef530-9fe1-4198-96bb-3977c10d4feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:15.130677 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bef530-9fe1-4198-96bb-3977c10d4feb None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:15.130956 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bef530-9fe1-4198-96bb-3977c10d4feb None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:15.131241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bef530-9fe1-4198-96bb-3977c10d4feb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:15.141917 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bef530-9fe1-4198-96bb-3977c10d4feb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:15.143392 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bef530-9fe1-4198-96bb-3977c10d4feb None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:15.153218 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac508e-d4e2-4d05-b30d-b1e84d2bb852 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:15.159642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-97bef530-9fe1-4198-96bb-3977c10d4feb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:15.159642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:15.159642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:15.159642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:15.159642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:15.159642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:15.159642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:15.159642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:15.159642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:15.159642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:15.159642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:15.159642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:15.159642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:15.159642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:15.159642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:15.160506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:15.160506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:15.160506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:15.160506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:15.160506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:15.160506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:15.160506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:15.160506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:15.160506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:15.160506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:15.160506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:15.160506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:15.160506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:15.160506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:15.160506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:15.160506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:15.160506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:15.161376 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:15.161376 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:15.161376 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:15.161376 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:15.161376 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 426/848] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:15.161643 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bef530-9fe1-4198-96bb-3977c10d4feb None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:15.193650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e3e7b-4cff-460f-84da-3a9d6129f683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:15.194598 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e3e7b-4cff-460f-84da-3a9d6129f683 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:15.195076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e3e7b-4cff-460f-84da-3a9d6129f683 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:15.195488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e3e7b-4cff-460f-84da-3a9d6129f683 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:15.196329 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e3e7b-4cff-460f-84da-3a9d6129f683 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:15.196770 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e3e7b-4cff-460f-84da-3a9d6129f683 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:15.198323 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e3e7b-4cff-460f-84da-3a9d6129f683 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:15.203079 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 423/849] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:48:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:15.203918 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e3e7b-4cff-460f-84da-3a9d6129f683 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:15.266682 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bef530-9fe1-4198-96bb-3977c10d4feb None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:15.302209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d647f-8714-48f0-9612-614a7dc24296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:15.302878 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d647f-8714-48f0-9612-614a7dc24296 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:15.303141 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d647f-8714-48f0-9612-614a7dc24296 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:15.303406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d647f-8714-48f0-9612-614a7dc24296 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:15.304181 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d647f-8714-48f0-9612-614a7dc24296 None admin] RBAC: Adding query filter params (name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:15.304482 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d647f-8714-48f0-9612-614a7dc24296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:15.305852 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d647f-8714-48f0-9612-614a7dc24296 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:15.309131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e3e7b-4cff-460f-84da-3a9d6129f683 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:15.318317 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 427/850] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:48:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:15.318317 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d647f-8714-48f0-9612-614a7dc24296 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:15.343394 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf69a2d-90ad-4fb9-911d-27baf33e8b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:15.344276 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf69a2d-90ad-4fb9-911d-27baf33e8b53 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:15.344555 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf69a2d-90ad-4fb9-911d-27baf33e8b53 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:15.344828 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf69a2d-90ad-4fb9-911d-27baf33e8b53 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:15.345545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf69a2d-90ad-4fb9-911d-27baf33e8b53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:15.345911 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf69a2d-90ad-4fb9-911d-27baf33e8b53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:15.347246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf69a2d-90ad-4fb9-911d-27baf33e8b53 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:15.358697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 424/851] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:15.359512 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf69a2d-90ad-4fb9-911d-27baf33e8b53 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:15.419261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d647f-8714-48f0-9612-614a7dc24296 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:15.453038 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01384011-a41b-4e0d-9672-332b8b5f57b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:15.453679 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384011-a41b-4e0d-9672-332b8b5f57b8 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:15.453983 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384011-a41b-4e0d-9672-332b8b5f57b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:15.454252 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384011-a41b-4e0d-9672-332b8b5f57b8 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:15.454996 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01384011-a41b-4e0d-9672-332b8b5f57b8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:15.455234 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01384011-a41b-4e0d-9672-332b8b5f57b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:15.456581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01384011-a41b-4e0d-9672-332b8b5f57b8 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:15.456777 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf69a2d-90ad-4fb9-911d-27baf33e8b53 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:15.470208 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 428/852] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:48:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:15.470208 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01384011-a41b-4e0d-9672-332b8b5f57b8 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:15.491982 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1c482-8a64-43f9-b3a4-7bd4cdfa3190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:15.492973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1c482-8a64-43f9-b3a4-7bd4cdfa3190 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:15.493231 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1c482-8a64-43f9-b3a4-7bd4cdfa3190 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:15.493495 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1c482-8a64-43f9-b3a4-7bd4cdfa3190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:15.504717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1c482-8a64-43f9-b3a4-7bd4cdfa3190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:15.506379 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1c482-8a64-43f9-b3a4-7bd4cdfa3190 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:15.524950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-f0a1c482-8a64-43f9-b3a4-7bd4cdfa3190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:15.524950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:15.524950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:15.524950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:15.524950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:15.524950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:15.524950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:15.524950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:15.524950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:15.524950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:15.524950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:15.524950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:15.524950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:15.524950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:15.524950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:15.525923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:15.525923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:15.525923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:15.525923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:15.525923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:15.525923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:15.525923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:15.525923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:15.525923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:15.525923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:15.525923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:15.525923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:15.525923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:15.525923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:15.525923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:15.525923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:15.525923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:15.527290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:15.527290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:15.527290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:15.527290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:15.527290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 425/853] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:15.533185 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1c482-8a64-43f9-b3a4-7bd4cdfa3190 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:15.574115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01384011-a41b-4e0d-9672-332b8b5f57b8 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:15.609751 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099af499-6cb5-402b-8884-fd523475a16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:15.610503 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099af499-6cb5-402b-8884-fd523475a16a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:15.610776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099af499-6cb5-402b-8884-fd523475a16a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:15.611043 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099af499-6cb5-402b-8884-fd523475a16a None admin] PATH_INFO: `/v3/users/swift` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:15.619674 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099af499-6cb5-402b-8884-fd523475a16a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:15.621138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099af499-6cb5-402b-8884-fd523475a16a None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:15.636963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-099af499-6cb5-402b-8884-fd523475a16a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 09:48:15.636963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:15.636963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:15.636963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:15.636963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:15.636963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:15.636963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:15.636963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:15.636963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:15.636963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:15.636963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:15.636963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:15.636963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:48:15.636963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:48:15.636963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:48:15.636963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:15.638973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:15.640113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:15.640113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:15.640113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:48:15.640113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:48:15.640113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:48:15.640113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:48:15.640113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:48:15.640113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:48:15.640113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 09:48:15.640113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:15.640113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 429/854] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:48:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:15.640823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1c482-8a64-43f9-b3a4-7bd4cdfa3190 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:15.647173 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099af499-6cb5-402b-8884-fd523475a16a None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:15.681214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe5eee-83a4-4fd2-8f79-7f47d9e44350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:15.681913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe5eee-83a4-4fd2-8f79-7f47d9e44350 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:15.682190 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe5eee-83a4-4fd2-8f79-7f47d9e44350 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:15.682457 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe5eee-83a4-4fd2-8f79-7f47d9e44350 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:15.683171 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe5eee-83a4-4fd2-8f79-7f47d9e44350 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:15.683473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe5eee-83a4-4fd2-8f79-7f47d9e44350 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:15.684820 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe5eee-83a4-4fd2-8f79-7f47d9e44350 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:15.701831 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 426/855] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:15.703583 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe5eee-83a4-4fd2-8f79-7f47d9e44350 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:15.763419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099af499-6cb5-402b-8884-fd523475a16a None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:15.806758 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a611ab-2b6e-437f-ae44-2d32af228e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:15.807425 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe5eee-83a4-4fd2-8f79-7f47d9e44350 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:15.807541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a611ab-2b6e-437f-ae44-2d32af228e99 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:15.807699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a611ab-2b6e-437f-ae44-2d32af228e99 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:15.807961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a611ab-2b6e-437f-ae44-2d32af228e99 None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:15.808959 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a611ab-2b6e-437f-ae44-2d32af228e99 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:15.809265 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a611ab-2b6e-437f-ae44-2d32af228e99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:15.811572 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a611ab-2b6e-437f-ae44-2d32af228e99 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:15.833941 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 430/856] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 3 09:48:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:15.841895 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a611ab-2b6e-437f-ae44-2d32af228e99 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:15.843547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c118205-fecd-4d82-93e0-e196ea16301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:15.844352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c118205-fecd-4d82-93e0-e196ea16301c None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:15.844626 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c118205-fecd-4d82-93e0-e196ea16301c None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:15.844889 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c118205-fecd-4d82-93e0-e196ea16301c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:15.852634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c118205-fecd-4d82-93e0-e196ea16301c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:15.854088 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c118205-fecd-4d82-93e0-e196ea16301c None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:15.868748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-0c118205-fecd-4d82-93e0-e196ea16301c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 09:48:15.868748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:15.868748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:15.868748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:15.868748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:15.868748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:15.868748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:15.868748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:15.868748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:15.868748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:15.868748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:15.868748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:15.868748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:48:15.868748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:48:15.868748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:48:15.868748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:15.869723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:15.875882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:15.875882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:15.875882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:48:15.875882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:48:15.875882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:48:15.875882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:48:15.875882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:48:15.875882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:48:15.875882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 09:48:15.875882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:15.875882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 427/857] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 3 09:48:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:15.878265 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c118205-fecd-4d82-93e0-e196ea16301c None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:15.947779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a611ab-2b6e-437f-ae44-2d32af228e99 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:15.983771 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e973ce2-d022-4ac1-b478-ac504da4223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:15.984434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e973ce2-d022-4ac1-b478-ac504da4223d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:15.984711 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e973ce2-d022-4ac1-b478-ac504da4223d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:15.984979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e973ce2-d022-4ac1-b478-ac504da4223d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:16.006802 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c118205-fecd-4d82-93e0-e196ea16301c None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:16.049916 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80e1c7-49e6-4e0a-a777-643844ddc846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:16.051120 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80e1c7-49e6-4e0a-a777-643844ddc846 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:16.051599 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80e1c7-49e6-4e0a-a777-643844ddc846 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:16.052525 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80e1c7-49e6-4e0a-a777-643844ddc846 None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:16.053853 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80e1c7-49e6-4e0a-a777-643844ddc846 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:16.054103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e973ce2-d022-4ac1-b478-ac504da4223d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:16.054643 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80e1c7-49e6-4e0a-a777-643844ddc846 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:16.055777 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e973ce2-d022-4ac1-b478-ac504da4223d None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:16.056467 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80e1c7-49e6-4e0a-a777-643844ddc846 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:16.083152 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 428/858] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 3 09:48:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:16.085406 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80e1c7-49e6-4e0a-a777-643844ddc846 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:16.163392 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 431/859] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:48:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 09:48:16.164291 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e973ce2-d022-4ac1-b478-ac504da4223d None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:16.199474 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80e1c7-49e6-4e0a-a777-643844ddc846 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:16.232789 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66baa0-31a5-4553-a2de-f4a4e71f5998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:16.233455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66baa0-31a5-4553-a2de-f4a4e71f5998 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:16.233737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66baa0-31a5-4553-a2de-f4a4e71f5998 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:16.234055 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66baa0-31a5-4553-a2de-f4a4e71f5998 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:16.267834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e973ce2-d022-4ac1-b478-ac504da4223d None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:16.301547 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c960ca-5ec3-4e89-9d2b-e0171355c45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:16.302370 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c960ca-5ec3-4e89-9d2b-e0171355c45e None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:16.302650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c960ca-5ec3-4e89-9d2b-e0171355c45e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:16.302944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c960ca-5ec3-4e89-9d2b-e0171355c45e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:16.309822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66baa0-31a5-4553-a2de-f4a4e71f5998 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:16.311373 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66baa0-31a5-4553-a2de-f4a4e71f5998 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:16.312816 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c960ca-5ec3-4e89-9d2b-e0171355c45e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:16.314290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c960ca-5ec3-4e89-9d2b-e0171355c45e None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:16.333699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-18c960ca-5ec3-4e89-9d2b-e0171355c45e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:16.333699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:16.333699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:16.333699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:16.333699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:16.333699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:16.333699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:16.333699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:16.333699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:16.333699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:16.333699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:16.333699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:16.333699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:16.333699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:16.333699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:16.334854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:16.334854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:16.334854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:16.334854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:16.334854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:16.334854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:16.334854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:16.334854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:16.334854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:16.334854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:16.334854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:16.334854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:16.334854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:16.334854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:16.334854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:16.334854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:16.334854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:16.335899 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:16.335899 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:16.335899 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:16.335899 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:16.335899 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 432/860] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:16.336696 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91981f8-a1a5-41ac-a5db-d536bdddc484 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:16.336997 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91981f8-a1a5-41ac-a5db-d536bdddc484 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:16.337257 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91981f8-a1a5-41ac-a5db-d536bdddc484 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:16.342054 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 433/861] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:16.342779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91981f8-a1a5-41ac-a5db-d536bdddc484 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:16.413577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 429/862] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:48:16 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:48:16.415312 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9b907-361a-4052-a2a8-7145e2b4dd59 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:16.415650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9b907-361a-4052-a2a8-7145e2b4dd59 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:16.415979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9b907-361a-4052-a2a8-7145e2b4dd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:16.433677 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-3af9b907-361a-4052-a2a8-7145e2b4dd59 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:16.434988 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-3af9b907-361a-4052-a2a8-7145e2b4dd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:16.449368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91981f8-a1a5-41ac-a5db-d536bdddc484 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:16.481975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a8cfa-7e47-458f-b4b6-222cb076a6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:16.482904 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a8cfa-7e47-458f-b4b6-222cb076a6ba None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:16.483178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a8cfa-7e47-458f-b4b6-222cb076a6ba None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:16.483442 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a8cfa-7e47-458f-b4b6-222cb076a6ba None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:16.484148 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a8cfa-7e47-458f-b4b6-222cb076a6ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:16.484448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a8cfa-7e47-458f-b4b6-222cb076a6ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:16.485811 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a8cfa-7e47-458f-b4b6-222cb076a6ba None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:16.496953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 434/863] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:16.501826 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 430/864] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:16.502505 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9b907-361a-4052-a2a8-7145e2b4dd59 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:16.510030 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a8cfa-7e47-458f-b4b6-222cb076a6ba None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:16.596837 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9b907-361a-4052-a2a8-7145e2b4dd59 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:16.608343 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a8cfa-7e47-458f-b4b6-222cb076a6ba None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:16.629827 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27d235-a4b7-4968-83da-4f5d205f61f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:16.630636 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27d235-a4b7-4968-83da-4f5d205f61f5 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:16.630916 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27d235-a4b7-4968-83da-4f5d205f61f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:16.631188 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27d235-a4b7-4968-83da-4f5d205f61f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:16.638846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27d235-a4b7-4968-83da-4f5d205f61f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:16.640510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27d235-a4b7-4968-83da-4f5d205f61f5 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:16.641607 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b931bc-342d-4044-ba32-77d962d20eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:16.642480 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b931bc-342d-4044-ba32-77d962d20eea None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:16.642761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b931bc-342d-4044-ba32-77d962d20eea None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:16.643033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b931bc-342d-4044-ba32-77d962d20eea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:16.654978 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b931bc-342d-4044-ba32-77d962d20eea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:16.655173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-fd27d235-a4b7-4968-83da-4f5d205f61f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:16.655173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:16.655173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:16.655173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:16.655173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:16.655173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:16.655173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:16.655173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:16.655173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:16.655173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:16.655173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:16.655173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:16.655173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:48:16.655173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:48:16.655173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:48:16.656006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:48:16.656006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:16.656006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:16.656006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:16.656006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:16.656006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:16.656006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:16.656006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:16.656006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:16.656006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:16.656006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:16.656006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:16.656006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:16.656006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:16.656006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:16.656006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:16.656006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:16.656863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:48:16.656863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:48:16.656863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:48:16.656863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:48:16.656863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:48:16.656863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:48:16.656863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:16.656863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:16.657748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b931bc-342d-4044-ba32-77d962d20eea None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:16.661194 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 431/865] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:16.662060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27d235-a4b7-4968-83da-4f5d205f61f5 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:16.675708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-82b931bc-342d-4044-ba32-77d962d20eea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:16.675708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:16.675708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:16.675708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:16.675708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:16.675708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:16.675708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:16.675708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:16.675708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:16.675708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:16.675708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:16.675708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:16.675708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:16.675708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:16.675708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:16.677017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:16.677017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:16.677017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:16.677017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:16.677017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:16.677017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:16.677017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:16.677017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:16.677017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:16.677017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:16.677017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:16.677017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:16.677017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:16.677017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:16.677017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:16.677017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:16.677017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:16.678267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:16.678267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:16.678267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:16.678267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:16.678267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 435/866] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:16.678267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b931bc-342d-4044-ba32-77d962d20eea None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:16.764309 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27d235-a4b7-4968-83da-4f5d205f61f5 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:16.770262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b931bc-342d-4044-ba32-77d962d20eea None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:16.802310 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f24824-16a8-452a-bc85-fa6bc8c74853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:16.802726 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786d027-d3b5-4418-bc3d-f639319764e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:16.802960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f24824-16a8-452a-bc85-fa6bc8c74853 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:16.803242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f24824-16a8-452a-bc85-fa6bc8c74853 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:16.803533 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f24824-16a8-452a-bc85-fa6bc8c74853 None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:16.804247 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786d027-d3b5-4418-bc3d-f639319764e8 None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:16.804509 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f24824-16a8-452a-bc85-fa6bc8c74853 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:16.804819 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f24824-16a8-452a-bc85-fa6bc8c74853 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:16.805111 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786d027-d3b5-4418-bc3d-f639319764e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:16.805569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786d027-d3b5-4418-bc3d-f639319764e8 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:16.806275 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f24824-16a8-452a-bc85-fa6bc8c74853 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:16.806695 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786d027-d3b5-4418-bc3d-f639319764e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:16.808768 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786d027-d3b5-4418-bc3d-f639319764e8 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:16.819378 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 436/867] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:48:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:16.820424 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f24824-16a8-452a-bc85-fa6bc8c74853 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:16.829050 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 432/868] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 3 09:48:16 2022] POST /identity/v3/services => generated 269 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:48:16.830055 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786d027-d3b5-4418-bc3d-f639319764e8 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:16.939485 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f24824-16a8-452a-bc85-fa6bc8c74853 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:16.951011 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786d027-d3b5-4418-bc3d-f639319764e8 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:16.981252 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49d30c-f49a-459b-a0d7-37e632b93a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:16.982215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49d30c-f49a-459b-a0d7-37e632b93a71 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:16.982633 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49d30c-f49a-459b-a0d7-37e632b93a71 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:16.983074 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49d30c-f49a-459b-a0d7-37e632b93a71 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:16.983933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49d30c-f49a-459b-a0d7-37e632b93a71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:16.984385 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49d30c-f49a-459b-a0d7-37e632b93a71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:16.985913 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49d30c-f49a-459b-a0d7-37e632b93a71 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:16.988833 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d3105-f5e6-4226-883a-2eaa4fae5f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:16.989120 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d3105-f5e6-4226-883a-2eaa4fae5f90 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:16.989399 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d3105-f5e6-4226-883a-2eaa4fae5f90 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:16.989674 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d3105-f5e6-4226-883a-2eaa4fae5f90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:16.990573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d3105-f5e6-4226-883a-2eaa4fae5f90 None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=73dfc1b485d647f1ae59a405c978599f) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:16.990888 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d3105-f5e6-4226-883a-2eaa4fae5f90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:16.993259 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d3105-f5e6-4226-883a-2eaa4fae5f90 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:17.004408 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 433/869] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:48:16 2022] GET /identity/v3/role_assignments?user.id=73dfc1b485d647f1ae59a405c978599f&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=52d3ad3e32c741938997691c9a909b81 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:17.004609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 437/870] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:17.005611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d3105-f5e6-4226-883a-2eaa4fae5f90 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:17.122697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d3105-f5e6-4226-883a-2eaa4fae5f90 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:17.158857 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024ca09-ef10-49cf-b426-feaa7b3d5af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:17.160041 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024ca09-ef10-49cf-b426-feaa7b3d5af2 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:17.160544 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024ca09-ef10-49cf-b426-feaa7b3d5af2 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:17.161009 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024ca09-ef10-49cf-b426-feaa7b3d5af2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:17.169494 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024ca09-ef10-49cf-b426-feaa7b3d5af2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:17.171331 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024ca09-ef10-49cf-b426-feaa7b3d5af2 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:17.187103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-b024ca09-ef10-49cf-b426-feaa7b3d5af2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:17.187103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:17.187103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:17.187103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:17.187103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:17.187103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:17.187103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:17.187103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:17.187103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:17.187103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:17.187103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:17.187103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:17.187103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:48:17.187103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:48:17.187103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:48:17.188053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:48:17.188053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:17.188053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:17.188053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:17.188053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:17.188053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:17.188053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:17.188053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:17.188053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:17.188053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:17.188053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:17.188053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:17.188053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:17.188053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:17.188053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:17.188053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:17.188053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:17.188934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:48:17.188934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:48:17.188934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:48:17.188934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:48:17.188934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:48:17.188934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:48:17.188934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:17.188934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:17.191568 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 434/871] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:17.197690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49d30c-f49a-459b-a0d7-37e632b93a71 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:17.310678 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49d30c-f49a-459b-a0d7-37e632b93a71 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:17.344405 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbbe34-adb2-443f-9e9f-194a219ff283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:17.345437 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbbe34-adb2-443f-9e9f-194a219ff283 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:17.345946 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbbe34-adb2-443f-9e9f-194a219ff283 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:17.346435 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbbe34-adb2-443f-9e9f-194a219ff283 None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:17.347423 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbbe34-adb2-443f-9e9f-194a219ff283 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:17.347947 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbbe34-adb2-443f-9e9f-194a219ff283 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:17.349547 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbbe34-adb2-443f-9e9f-194a219ff283 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:17.362310 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 438/872] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:48:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:17.368680 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024ca09-ef10-49cf-b426-feaa7b3d5af2 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:17.467422 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024ca09-ef10-49cf-b426-feaa7b3d5af2 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:17.502750 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ec732-2ec8-4d41-8797-cd562911c770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:17.504208 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ec732-2ec8-4d41-8797-cd562911c770 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:17.504687 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ec732-2ec8-4d41-8797-cd562911c770 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:17.505152 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ec732-2ec8-4d41-8797-cd562911c770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:17.506227 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ec732-2ec8-4d41-8797-cd562911c770 None admin] RBAC: Adding query filter params (role.id=779b01e1e2534bfba9971e7000b7c628, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=62b336ab0cfd4bfd9ec498dcd940332f) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:17.506731 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ec732-2ec8-4d41-8797-cd562911c770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:17.508878 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ec732-2ec8-4d41-8797-cd562911c770 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:17.515194 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 435/873] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:48:17 2022] GET /identity/v3/role_assignments?user.id=62b336ab0cfd4bfd9ec498dcd940332f&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=779b01e1e2534bfba9971e7000b7c628 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:17.763660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07bc71-b599-4660-8174-45c8174dd7bc None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:17.764172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07bc71-b599-4660-8174-45c8174dd7bc None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:17.764172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07bc71-b599-4660-8174-45c8174dd7bc None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:17.765600 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 439/874] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:17.771045 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb159c-43b9-4443-9712-90538709e8f5 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:17.771557 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb159c-43b9-4443-9712-90538709e8f5 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:17.772023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb159c-43b9-4443-9712-90538709e8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:17.790991 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-f7bb159c-43b9-4443-9712-90538709e8f5 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:17.792494 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-f7bb159c-43b9-4443-9712-90538709e8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:17.859148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 436/875] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:17 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:48:17.881476 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07bc71-b599-4660-8174-45c8174dd7bc None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:17.980596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07bc71-b599-4660-8174-45c8174dd7bc None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:18.014309 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bd51b-4b54-45ea-9958-b31df8df6b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:18.015314 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bd51b-4b54-45ea-9958-b31df8df6b29 None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:18.015796 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bd51b-4b54-45ea-9958-b31df8df6b29 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:18.016256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bd51b-4b54-45ea-9958-b31df8df6b29 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:18.017175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bd51b-4b54-45ea-9958-b31df8df6b29 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:18.018742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bd51b-4b54-45ea-9958-b31df8df6b29 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:18.034546 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 440/876] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 3 09:48:17 2022] POST /identity/v3/services => generated 251 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:48:19.192385 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e997ff-d324-4a31-80f7-199f4e8d208f None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:19.192912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e997ff-d324-4a31-80f7-199f4e8d208f None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:19.193021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e997ff-d324-4a31-80f7-199f4e8d208f None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:19.194975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 437/877] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:19.200364 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7a49d-2bac-4ff2-8a8d-e64cd51f636f None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:19.200779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7a49d-2bac-4ff2-8a8d-e64cd51f636f None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:19.200946 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7a49d-2bac-4ff2-8a8d-e64cd51f636f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:19.217975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-e2e7a49d-2bac-4ff2-8a8d-e64cd51f636f None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:19.219155 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-e2e7a49d-2bac-4ff2-8a8d-e64cd51f636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:19.291004 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 441/878] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:19.313595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e997ff-d324-4a31-80f7-199f4e8d208f None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:19.357582 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28b75-aff5-40f4-8f23-5f62bb1d9230 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:19.357893 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28b75-aff5-40f4-8f23-5f62bb1d9230 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:19.358170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28b75-aff5-40f4-8f23-5f62bb1d9230 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:19.359794 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 442/879] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:48:19.366594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd921d-7bae-43ca-b9d2-0ac4f519a36e None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:19.366885 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd921d-7bae-43ca-b9d2-0ac4f519a36e None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:19.367161 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd921d-7bae-43ca-b9d2-0ac4f519a36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:19.388585 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-8dbd921d-7bae-43ca-b9d2-0ac4f519a36e None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:19.389771 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-8dbd921d-7bae-43ca-b9d2-0ac4f519a36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:19.416091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e997ff-d324-4a31-80f7-199f4e8d208f None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:19.449588 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417d05d-dd5f-4b07-9327-d88d2be2a49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:19.450357 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417d05d-dd5f-4b07-9327-d88d2be2a49e None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:19.450637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417d05d-dd5f-4b07-9327-d88d2be2a49e None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:19.450907 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417d05d-dd5f-4b07-9327-d88d2be2a49e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:19.451563 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417d05d-dd5f-4b07-9327-d88d2be2a49e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:19.452929 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417d05d-dd5f-4b07-9327-d88d2be2a49e None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:19.465473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-e417d05d-dd5f-4b07-9327-d88d2be2a49e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 09:48:19.465473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:19.465473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:19.465473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:19.465473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:19.465473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:19.465473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:19.465473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:19.465473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 09:48:19.465473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:19.465473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:19.465473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:19.465473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:19.465473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:19.465473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:19.465473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:19.467392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:19.467392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:19.467392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:19.467392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:19.467392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:19.467392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:19.467392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:19.467392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:19.467392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:19.467392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:19.467392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:19.467392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:19.467392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:19.467392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:19.467392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:19.467392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:19.468510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:19.468510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:19.468510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:19.468510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:19.468510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:19.468510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:19.468510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:19.468510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:19.468510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:19.468510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:19.468510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:19.468510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:19.468510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:19.468510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 09:48:19.468510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:19.468510 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 438/880] 10.222.0.55 () {56 vars in 1132 bytes} [Tue May 3 09:48:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:19.473239 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417d05d-dd5f-4b07-9327-d88d2be2a49e None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:19.475035 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 443/881] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:19.497971 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd921d-7bae-43ca-b9d2-0ac4f519a36e None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:19.595942 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417d05d-dd5f-4b07-9327-d88d2be2a49e None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:19.605540 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd921d-7bae-43ca-b9d2-0ac4f519a36e None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:19.630440 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ee413-b7d9-4585-aee8-e107e73ade35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:19.631104 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ee413-b7d9-4585-aee8-e107e73ade35 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:19.631385 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ee413-b7d9-4585-aee8-e107e73ade35 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:19.631668 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ee413-b7d9-4585-aee8-e107e73ade35 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:19.632760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ee413-b7d9-4585-aee8-e107e73ade35 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:19.633738 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ee413-b7d9-4585-aee8-e107e73ade35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:19.635156 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ee413-b7d9-4585-aee8-e107e73ade35 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:19.644753 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 439/882] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 3 09:48:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:19.646092 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ee413-b7d9-4585-aee8-e107e73ade35 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:19.648362 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ffe70-e083-43bd-ad8f-4e5d0ed40693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:19.649823 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ffe70-e083-43bd-ad8f-4e5d0ed40693 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:19.651137 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ffe70-e083-43bd-ad8f-4e5d0ed40693 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:19.651616 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ffe70-e083-43bd-ad8f-4e5d0ed40693 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:19.652490 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ffe70-e083-43bd-ad8f-4e5d0ed40693 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:19.654081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ffe70-e083-43bd-ad8f-4e5d0ed40693 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:19.669289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-183ffe70-e083-43bd-ad8f-4e5d0ed40693 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 09:48:19.669289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:19.669289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:19.669289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:19.669289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:19.669289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:19.669289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:19.669289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:19.669289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 09:48:19.669289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:19.669289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:19.669289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:19.669289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:19.669289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:19.669289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:19.669289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:19.669289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:19.670323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:19.670323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:19.670323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:19.670323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:19.670323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:19.670323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:19.670323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:19.670323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:19.670323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:19.670323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:19.670323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:19.670323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:19.670323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:19.670323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:19.670323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:19.670323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:19.671199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:19.671199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:19.671199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:19.671199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:19.671199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:19.671199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:19.671199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:19.671199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:19.671199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:19.671199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:19.671199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:19.671199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:19.671199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 09:48:19.671199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:19.675546 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 444/883] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 3 09:48:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:19.676805 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ffe70-e083-43bd-ad8f-4e5d0ed40693 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:19.765663 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ee413-b7d9-4585-aee8-e107e73ade35 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:19.797050 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ffe70-e083-43bd-ad8f-4e5d0ed40693 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:19.806329 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e56fa-89af-4b36-8486-50a832abe95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:19.807011 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e56fa-89af-4b36-8486-50a832abe95f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:19.807378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e56fa-89af-4b36-8486-50a832abe95f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:19.807721 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e56fa-89af-4b36-8486-50a832abe95f None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:19.808506 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e56fa-89af-4b36-8486-50a832abe95f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:19.808878 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e56fa-89af-4b36-8486-50a832abe95f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:19.810358 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e56fa-89af-4b36-8486-50a832abe95f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:19.820912 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 440/884] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 3 09:48:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:19.822707 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e56fa-89af-4b36-8486-50a832abe95f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:19.838073 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a7a29-f417-4ec8-8ada-fc09d1ab5141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:19.839485 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a7a29-f417-4ec8-8ada-fc09d1ab5141 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:19.839950 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a7a29-f417-4ec8-8ada-fc09d1ab5141 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:19.840688 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a7a29-f417-4ec8-8ada-fc09d1ab5141 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:19.841577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a7a29-f417-4ec8-8ada-fc09d1ab5141 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:19.842228 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a7a29-f417-4ec8-8ada-fc09d1ab5141 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:19.844086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a7a29-f417-4ec8-8ada-fc09d1ab5141 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:19.850925 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 445/885] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 3 09:48:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:19.858109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a7a29-f417-4ec8-8ada-fc09d1ab5141 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:19.931925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e56fa-89af-4b36-8486-50a832abe95f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:19.966055 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a7a29-f417-4ec8-8ada-fc09d1ab5141 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:19.967089 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101654f-d150-4d09-b0e2-e7ff4303ac94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:19.967914 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101654f-d150-4d09-b0e2-e7ff4303ac94 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:19.968977 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101654f-d150-4d09-b0e2-e7ff4303ac94 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:19.969262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101654f-d150-4d09-b0e2-e7ff4303ac94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:19.970088 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101654f-d150-4d09-b0e2-e7ff4303ac94 None admin] RBAC: Adding query filter params (interface=public, service_id=c7bebc54632e4bd3809d325ae65269fd, region_id=RegionOne) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:19.970403 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101654f-d150-4d09-b0e2-e7ff4303ac94 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:19.971767 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101654f-d150-4d09-b0e2-e7ff4303ac94 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:19.986326 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 441/886] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 3 09:48:19 2022] GET /identity/v3/endpoints?service_id=c7bebc54632e4bd3809d325ae65269fd&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:19.986326 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbe82e-45bb-49ec-8629-d7d679642668 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:19.986326 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbe82e-45bb-49ec-8629-d7d679642668 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:19.986326 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbe82e-45bb-49ec-8629-d7d679642668 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:19.986653 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 442/887] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:19.989933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbe82e-45bb-49ec-8629-d7d679642668 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:19.999125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4957e5-e701-436b-97f1-b5f9f377e0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:19.999791 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4957e5-e701-436b-97f1-b5f9f377e0a3 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:20.000072 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4957e5-e701-436b-97f1-b5f9f377e0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:20.000345 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4957e5-e701-436b-97f1-b5f9f377e0a3 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:20.001049 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4957e5-e701-436b-97f1-b5f9f377e0a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:20.001356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4957e5-e701-436b-97f1-b5f9f377e0a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:20.002739 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4957e5-e701-436b-97f1-b5f9f377e0a3 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:20.007156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 446/888] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 3 09:48:19 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:20.008657 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb03b4-a724-4ede-972d-2392cd15de92 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:20.008941 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb03b4-a724-4ede-972d-2392cd15de92 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:20.009216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb03b4-a724-4ede-972d-2392cd15de92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:20.026557 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-8dcb03b4-a724-4ede-972d-2392cd15de92 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:20.027692 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-8dcb03b4-a724-4ede-972d-2392cd15de92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:20.118130 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbe82e-45bb-49ec-8629-d7d679642668 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:20.120207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 447/889] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:20.143876 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb03b4-a724-4ede-972d-2392cd15de92 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:20.164663 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6a9e9-9f96-4227-ad7b-d584822e328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:20.165747 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6a9e9-9f96-4227-ad7b-d584822e328f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:20.166771 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6a9e9-9f96-4227-ad7b-d584822e328f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:20.167278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6a9e9-9f96-4227-ad7b-d584822e328f None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:20.168504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6a9e9-9f96-4227-ad7b-d584822e328f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:20.170716 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6a9e9-9f96-4227-ad7b-d584822e328f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:20.186117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 443/890] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 3 09:48:19 2022] GET /identity/v3/services => generated 1268 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:48:20.269072 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb03b4-a724-4ede-972d-2392cd15de92 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:20.306069 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfa1b0-403b-437a-aed1-f2c5d3db9585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:20.306913 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfa1b0-403b-437a-aed1-f2c5d3db9585 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:20.307192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfa1b0-403b-437a-aed1-f2c5d3db9585 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:20.307461 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfa1b0-403b-437a-aed1-f2c5d3db9585 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:20.310909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c792da9-d4fc-4728-8b93-47a97aa0dffa None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:20.311417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c792da9-d4fc-4728-8b93-47a97aa0dffa None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:20.311495 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c792da9-d4fc-4728-8b93-47a97aa0dffa None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:20.313208 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 444/891] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:48:20.319099 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc5c8d-ec09-4bd0-a483-5fddf64b2a6b None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:20.319436 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc5c8d-ec09-4bd0-a483-5fddf64b2a6b None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:20.319781 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc5c8d-ec09-4bd0-a483-5fddf64b2a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:20.324545 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfa1b0-403b-437a-aed1-f2c5d3db9585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:48:20.332744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-44bfa1b0-403b-437a-aed1-f2c5d3db9585 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 09:48:20.332744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:20.332744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:20.332744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:20.332744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:20.332744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:20.332744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:20.332744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:20.332744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:20.332744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:20.332744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:20.332744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:20.332744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:48:20.332744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:48:20.332744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:48:20.332744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:48:20.333745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:48:20.333745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:48:20.333745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:48:20.333745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:48:20.333745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:20.333745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:20.333745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:20.333745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:20.333745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:20.333745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:20.333745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:20.333745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:20.333745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:20.333745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:20.333745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:20.333745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:20.334619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:20.334619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:20.334619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:20.334619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:20.334619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:48:20.334619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:48:20.334619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:48:20.334619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:48:20.334619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:48:20.334619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:48:20.334619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 09:48:20.334619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:20.334619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 448/892] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 3 09:48:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:20.340288 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-71fc5c8d-ec09-4bd0-a483-5fddf64b2a6b None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:20.341840 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-71fc5c8d-ec09-4bd0-a483-5fddf64b2a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:20.342918 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfa1b0-403b-437a-aed1-f2c5d3db9585 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:20.437614 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 445/893] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:20.448892 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfa1b0-403b-437a-aed1-f2c5d3db9585 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:20.467383 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc5c8d-ec09-4bd0-a483-5fddf64b2a6b None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:20.487456 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142b00-10db-4509-ad49-f3e7f9d671f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:20.488749 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142b00-10db-4509-ad49-f3e7f9d671f8 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:20.489248 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142b00-10db-4509-ad49-f3e7f9d671f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:20.489731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142b00-10db-4509-ad49-f3e7f9d671f8 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:20.490712 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4142b00-10db-4509-ad49-f3e7f9d671f8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:20.491603 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4142b00-10db-4509-ad49-f3e7f9d671f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:20.493451 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4142b00-10db-4509-ad49-f3e7f9d671f8 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:20.510768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 449/894] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 3 09:48:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:20.511947 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142b00-10db-4509-ad49-f3e7f9d671f8 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:20.579365 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc5c8d-ec09-4bd0-a483-5fddf64b2a6b None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:20.612240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd1b85-dd26-4c62-8ff0-c23d46267eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:20.613241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd1b85-dd26-4c62-8ff0-c23d46267eac None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:20.613613 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd1b85-dd26-4c62-8ff0-c23d46267eac None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:20.613999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd1b85-dd26-4c62-8ff0-c23d46267eac None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:20.614771 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd1b85-dd26-4c62-8ff0-c23d46267eac None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:20.616235 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd1b85-dd26-4c62-8ff0-c23d46267eac None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:20.628091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-a9cd1b85-dd26-4c62-8ff0-c23d46267eac None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 09:48:20.628091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:20.628091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:20.628091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:20.628091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:20.628091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:20.628091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:20.628091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:20.628091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 09:48:20.628091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:20.628091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:20.628091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:20.628091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:20.628091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:20.628091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:20.628091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:20.628091 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:20.629306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:20.629306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:20.629306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:20.629306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:20.629306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:20.629306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:20.629306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:20.629306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:20.629306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:20.629306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:20.629306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:20.629306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:20.629306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:20.629306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:20.629306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:20.629306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:20.630382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:20.630382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:20.630382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:20.630382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:20.630382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:20.630382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:20.630382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:20.630382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:20.630382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:20.630382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:20.630382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:20.630382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:20.630382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 09:48:20.630382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:20.638518 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 446/895] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:48:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:20.639188 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142b00-10db-4509-ad49-f3e7f9d671f8 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:20.640063 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd1b85-dd26-4c62-8ff0-c23d46267eac None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:20.674197 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf24ce-246f-44c9-8286-78e11746b930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:20.675419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf24ce-246f-44c9-8286-78e11746b930 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:20.675787 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf24ce-246f-44c9-8286-78e11746b930 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:20.676310 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf24ce-246f-44c9-8286-78e11746b930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:20.688771 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf24ce-246f-44c9-8286-78e11746b930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:20.690975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf24ce-246f-44c9-8286-78e11746b930 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:20.714685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-f3bf24ce-246f-44c9-8286-78e11746b930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:20.714685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:20.714685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:20.714685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:20.714685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:20.714685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:20.714685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:20.714685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:20.714685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:20.714685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:20.714685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:20.714685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:20.714685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:20.714685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:20.714685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:20.715609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:20.715609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:20.715609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:20.715609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:20.715609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:20.715609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:20.715609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:20.715609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:20.715609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:20.715609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:20.715609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:20.715609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:20.715609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:20.715609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:20.715609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:20.715609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:20.715609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:20.716510 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:20.716510 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:20.716510 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:20.716510 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:20.723177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 450/896] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:20.724210 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf24ce-246f-44c9-8286-78e11746b930 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:20.754222 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd1b85-dd26-4c62-8ff0-c23d46267eac None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:20.787178 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec16dd-d6e4-4b80-9ace-d152b84f1e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:20.787923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec16dd-d6e4-4b80-9ace-d152b84f1e68 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:20.788269 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec16dd-d6e4-4b80-9ace-d152b84f1e68 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:20.788630 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec16dd-d6e4-4b80-9ace-d152b84f1e68 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:20.789398 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec16dd-d6e4-4b80-9ace-d152b84f1e68 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:20.789764 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec16dd-d6e4-4b80-9ace-d152b84f1e68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:20.791206 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec16dd-d6e4-4b80-9ace-d152b84f1e68 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:20.797845 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 447/897] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:48:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:20.801941 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec16dd-d6e4-4b80-9ace-d152b84f1e68 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:20.830542 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf24ce-246f-44c9-8286-78e11746b930 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:20.863613 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d5f71-a8e1-470c-919d-ae70a17e9bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:20.864274 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d5f71-a8e1-470c-919d-ae70a17e9bba None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:20.864551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d5f71-a8e1-470c-919d-ae70a17e9bba None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:20.864821 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d5f71-a8e1-470c-919d-ae70a17e9bba None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:20.865547 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d5f71-a8e1-470c-919d-ae70a17e9bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:20.865884 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d5f71-a8e1-470c-919d-ae70a17e9bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:20.867323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d5f71-a8e1-470c-919d-ae70a17e9bba None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:20.884288 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 451/898] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:20.885201 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d5f71-a8e1-470c-919d-ae70a17e9bba None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:20.905515 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec16dd-d6e4-4b80-9ace-d152b84f1e68 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:20.939405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc867ed-14c8-4812-9ca6-30af89c8fc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:20.940115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc867ed-14c8-4812-9ca6-30af89c8fc09 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:20.940392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc867ed-14c8-4812-9ca6-30af89c8fc09 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:20.940657 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc867ed-14c8-4812-9ca6-30af89c8fc09 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:20.941386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc867ed-14c8-4812-9ca6-30af89c8fc09 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:20.941843 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc867ed-14c8-4812-9ca6-30af89c8fc09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:20.943050 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc867ed-14c8-4812-9ca6-30af89c8fc09 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:20.952829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 448/899] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:48:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:20.954613 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc867ed-14c8-4812-9ca6-30af89c8fc09 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:21.010784 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d5f71-a8e1-470c-919d-ae70a17e9bba None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:21.059216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450311db-e00e-443b-8921-76d10a32612b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:21.060186 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450311db-e00e-443b-8921-76d10a32612b None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:21.060553 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450311db-e00e-443b-8921-76d10a32612b None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:21.060955 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450311db-e00e-443b-8921-76d10a32612b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:21.061369 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc867ed-14c8-4812-9ca6-30af89c8fc09 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:21.070029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450311db-e00e-443b-8921-76d10a32612b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:21.072254 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450311db-e00e-443b-8921-76d10a32612b None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:21.091934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-450311db-e00e-443b-8921-76d10a32612b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 09:48:21.091934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:21.091934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:21.091934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:21.091934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:21.091934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:21.091934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:21.091934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:21.091934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:21.091934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:21.091934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:21.091934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:21.091934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:48:21.091934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:48:21.091934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:48:21.091934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:21.093023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:21.100103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:21.100103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:21.100103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:48:21.100103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:48:21.100103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:48:21.100103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:48:21.100103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:48:21.100103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:48:21.100103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 09:48:21.100103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:21.100103 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 452/900] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 3 09:48:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:21.101207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450311db-e00e-443b-8921-76d10a32612b None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:21.104327 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae3099-f41a-46c2-bc54-1012bd989352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:21.105273 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae3099-f41a-46c2-bc54-1012bd989352 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:21.105777 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae3099-f41a-46c2-bc54-1012bd989352 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:21.106297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae3099-f41a-46c2-bc54-1012bd989352 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:21.107303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae3099-f41a-46c2-bc54-1012bd989352 None admin] RBAC: Adding query filter params (interface=public, service_id=27af9f837d7746fa903c3cfc92bc556b, region_id=RegionOne) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:21.107824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae3099-f41a-46c2-bc54-1012bd989352 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:21.109395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae3099-f41a-46c2-bc54-1012bd989352 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:21.120256 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 449/901] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 3 09:48:20 2022] GET /identity/v3/endpoints?service_id=27af9f837d7746fa903c3cfc92bc556b&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:21.121490 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae3099-f41a-46c2-bc54-1012bd989352 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:21.209574 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450311db-e00e-443b-8921-76d10a32612b None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:21.232690 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae3099-f41a-46c2-bc54-1012bd989352 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:21.246432 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935af9a0-c947-4974-aa6d-4b169a9c6ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:21.247589 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935af9a0-c947-4974-aa6d-4b169a9c6ee5 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:21.248073 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935af9a0-c947-4974-aa6d-4b169a9c6ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:21.248553 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935af9a0-c947-4974-aa6d-4b169a9c6ee5 None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:21.249602 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935af9a0-c947-4974-aa6d-4b169a9c6ee5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:21.250134 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935af9a0-c947-4974-aa6d-4b169a9c6ee5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:21.251779 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935af9a0-c947-4974-aa6d-4b169a9c6ee5 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:21.272310 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bcdb6-eecb-4094-8ecc-3ed6989bd648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:21.273178 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bcdb6-eecb-4094-8ecc-3ed6989bd648 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:21.273551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bcdb6-eecb-4094-8ecc-3ed6989bd648 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:21.273954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bcdb6-eecb-4094-8ecc-3ed6989bd648 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:21.274739 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bcdb6-eecb-4094-8ecc-3ed6989bd648 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:21.275323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 453/902] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 3 09:48:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:21.280468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bcdb6-eecb-4094-8ecc-3ed6989bd648 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:21.281659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935af9a0-c947-4974-aa6d-4b169a9c6ee5 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:21.285820 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 450/903] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 3 09:48:21 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:48:21.397544 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935af9a0-c947-4974-aa6d-4b169a9c6ee5 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:21.433677 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26555d48-b0c2-4fc9-8bce-83d90c41377e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:21.434712 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26555d48-b0c2-4fc9-8bce-83d90c41377e None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:21.435158 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26555d48-b0c2-4fc9-8bce-83d90c41377e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:21.435656 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26555d48-b0c2-4fc9-8bce-83d90c41377e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:21.503665 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26555d48-b0c2-4fc9-8bce-83d90c41377e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:21.505418 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26555d48-b0c2-4fc9-8bce-83d90c41377e None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:21.603430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 454/904] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:48:21 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:48:21.609216 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bcdb6-eecb-4094-8ecc-3ed6989bd648 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:21.705569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bcdb6-eecb-4094-8ecc-3ed6989bd648 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:21.738455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5a4b6-607f-4fa4-bd66-271d61fac2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:21.739299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5a4b6-607f-4fa4-bd66-271d61fac2e2 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:21.739579 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5a4b6-607f-4fa4-bd66-271d61fac2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:21.739852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5a4b6-607f-4fa4-bd66-271d61fac2e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:21.750564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5a4b6-607f-4fa4-bd66-271d61fac2e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:21.752001 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5a4b6-607f-4fa4-bd66-271d61fac2e2 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:21.769569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-cce5a4b6-607f-4fa4-bd66-271d61fac2e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:21.769569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:21.769569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:21.769569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:21.769569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:21.769569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:21.769569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:21.769569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:21.769569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:21.769569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:21.769569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:21.769569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:21.769569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:21.769569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:21.769569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:21.770619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:21.770619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:21.770619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:21.770619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:21.770619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:21.770619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:21.770619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:21.770619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:21.770619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:21.770619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:21.770619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:21.770619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:21.770619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:21.770619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:21.770619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:21.770619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:21.770619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:21.771545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:21.771545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:21.771545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:21.771545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:21.771545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 451/905] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:21.776970 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26555d48-b0c2-4fc9-8bce-83d90c41377e None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:21.874253 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26555d48-b0c2-4fc9-8bce-83d90c41377e None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:21.908515 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a51e3-0810-4301-8754-bb4162f14514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:21.909178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a51e3-0810-4301-8754-bb4162f14514 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:21.909458 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a51e3-0810-4301-8754-bb4162f14514 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:21.909725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a51e3-0810-4301-8754-bb4162f14514 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:21.910469 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a51e3-0810-4301-8754-bb4162f14514 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:21.910771 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a51e3-0810-4301-8754-bb4162f14514 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:21.912123 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a51e3-0810-4301-8754-bb4162f14514 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:21.923949 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 455/906] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:21.929826 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5a4b6-607f-4fa4-bd66-271d61fac2e2 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:22.031019 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5a4b6-607f-4fa4-bd66-271d61fac2e2 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:22.065558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ddebf-0027-480e-9c28-58f435eefc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:22.066782 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ddebf-0027-480e-9c28-58f435eefc51 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:22.067251 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ddebf-0027-480e-9c28-58f435eefc51 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:22.067719 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ddebf-0027-480e-9c28-58f435eefc51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:22.076603 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ddebf-0027-480e-9c28-58f435eefc51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:22.078360 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ddebf-0027-480e-9c28-58f435eefc51 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:22.092656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-2a5ddebf-0027-480e-9c28-58f435eefc51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:22.092656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:22.092656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:22.092656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:22.092656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:22.092656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:22.092656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:22.092656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:22.092656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:22.092656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:22.092656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:22.092656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:22.092656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:48:22.092656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:48:22.092656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:48:22.093580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:48:22.093580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:22.093580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:22.093580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:22.093580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:22.093580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:22.093580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:22.093580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:22.093580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:22.093580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:22.093580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:22.093580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:22.093580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:22.093580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:22.093580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:22.093580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:22.093580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:22.094491 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:48:22.094491 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:48:22.094491 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:48:22.094491 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:48:22.094491 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:48:22.094491 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:48:22.094491 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:22.094491 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:22.096907 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 452/907] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:22.103207 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a51e3-0810-4301-8754-bb4162f14514 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:22.204252 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a51e3-0810-4301-8754-bb4162f14514 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:22.241924 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681f8b1-1a7c-4462-96eb-34ff297983e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:22.242773 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681f8b1-1a7c-4462-96eb-34ff297983e8 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:22.243055 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681f8b1-1a7c-4462-96eb-34ff297983e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:22.243332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681f8b1-1a7c-4462-96eb-34ff297983e8 None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:22.244138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681f8b1-1a7c-4462-96eb-34ff297983e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:22.244442 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681f8b1-1a7c-4462-96eb-34ff297983e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:22.245988 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681f8b1-1a7c-4462-96eb-34ff297983e8 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:22.259898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 456/908] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:48:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:22.265776 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ddebf-0027-480e-9c28-58f435eefc51 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:22.369216 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ddebf-0027-480e-9c28-58f435eefc51 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:22.403687 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1ece7-5616-4c75-8f19-50c88ab114c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:22.404346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1ece7-5616-4c75-8f19-50c88ab114c0 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:22.404669 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1ece7-5616-4c75-8f19-50c88ab114c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:22.404944 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1ece7-5616-4c75-8f19-50c88ab114c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:22.405769 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1ece7-5616-4c75-8f19-50c88ab114c0 None admin] RBAC: Adding query filter params (role.id=97c22875d1454453affa45b653c6eeed, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=62b336ab0cfd4bfd9ec498dcd940332f) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:22.406101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1ece7-5616-4c75-8f19-50c88ab114c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:22.407519 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1ece7-5616-4c75-8f19-50c88ab114c0 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:22.413498 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 453/909] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:48:22 2022] GET /identity/v3/role_assignments?user.id=62b336ab0cfd4bfd9ec498dcd940332f&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=97c22875d1454453affa45b653c6eeed => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:22.418443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba904d25-37b7-4a36-a229-e508e805f8df None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:22.418954 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba904d25-37b7-4a36-a229-e508e805f8df None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:22.418954 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba904d25-37b7-4a36-a229-e508e805f8df None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:22.420622 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 457/910] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:22.427697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b6d5-29ad-4fe5-9ebe-b8b587206aa2 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:22.428033 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b6d5-29ad-4fe5-9ebe-b8b587206aa2 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:22.428545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b6d5-29ad-4fe5-9ebe-b8b587206aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:22.446619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-dcb1b6d5-29ad-4fe5-9ebe-b8b587206aa2 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:22.447822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-dcb1b6d5-29ad-4fe5-9ebe-b8b587206aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:22.524174 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 454/911] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:22.536830 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf60374-cb18-4677-80ee-079754f47608 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:22.537180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf60374-cb18-4677-80ee-079754f47608 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:22.537371 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf60374-cb18-4677-80ee-079754f47608 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:22.539298 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 458/912] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:22.547836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601435f-3cc6-430c-9403-4ddbfb8befa0 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:22.548459 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601435f-3cc6-430c-9403-4ddbfb8befa0 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:22.548898 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601435f-3cc6-430c-9403-4ddbfb8befa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:22.553341 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf60374-cb18-4677-80ee-079754f47608 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:22.567436 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-a601435f-3cc6-430c-9403-4ddbfb8befa0 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:22.568945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-a601435f-3cc6-430c-9403-4ddbfb8befa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:22.639067 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 455/913] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:22.658695 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf60374-cb18-4677-80ee-079754f47608 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:22.663941 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601435f-3cc6-430c-9403-4ddbfb8befa0 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:22.692381 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dee81a-8684-46ed-bcaa-cf6931d09ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:22.693049 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dee81a-8684-46ed-bcaa-cf6931d09ac1 None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:22.693328 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dee81a-8684-46ed-bcaa-cf6931d09ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:22.693611 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dee81a-8684-46ed-bcaa-cf6931d09ac1 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:22.694368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dee81a-8684-46ed-bcaa-cf6931d09ac1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:22.695796 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dee81a-8684-46ed-bcaa-cf6931d09ac1 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:22.711491 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 459/914] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 3 09:48:22 2022] POST /identity/v3/services => generated 241 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:48:22.771403 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601435f-3cc6-430c-9403-4ddbfb8befa0 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:22.814083 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67c82e-e0d5-4748-b0bd-c5ec46e06c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:22.814819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67c82e-e0d5-4748-b0bd-c5ec46e06c7a None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:22.815097 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67c82e-e0d5-4748-b0bd-c5ec46e06c7a None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:22.815361 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67c82e-e0d5-4748-b0bd-c5ec46e06c7a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:22.816016 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67c82e-e0d5-4748-b0bd-c5ec46e06c7a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:22.817403 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67c82e-e0d5-4748-b0bd-c5ec46e06c7a None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:22.830513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-db67c82e-e0d5-4748-b0bd-c5ec46e06c7a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 09:48:22.830513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:22.830513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:22.830513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:22.830513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:22.830513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:22.830513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:22.830513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:22.830513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 09:48:22.830513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:22.830513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:22.830513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:22.830513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:22.830513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:22.830513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:22.830513 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:22.831621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:22.831621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:22.831621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:22.831621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:22.831621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:22.831621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:22.831621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:22.831621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:22.831621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:22.831621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:22.831621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:22.831621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:22.831621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:22.831621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:22.831621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:22.831621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:22.832508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:22.832508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:22.832508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:22.832508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:22.832508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:22.832508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:22.832508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:22.832508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:22.832508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:22.832508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:22.832508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:22.832508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:22.832508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:22.832508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 09:48:22.832508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:22.832508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 456/915] 10.222.0.55 () {56 vars in 1132 bytes} [Tue May 3 09:48:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:22.840408 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dee81a-8684-46ed-bcaa-cf6931d09ac1 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:22.948405 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dee81a-8684-46ed-bcaa-cf6931d09ac1 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:22.981565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62897e1-0204-4623-aa08-cd3f78da2edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:22.982600 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62897e1-0204-4623-aa08-cd3f78da2edc None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:22.983115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62897e1-0204-4623-aa08-cd3f78da2edc None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:22.983582 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62897e1-0204-4623-aa08-cd3f78da2edc None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:22.984486 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62897e1-0204-4623-aa08-cd3f78da2edc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:22.984999 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62897e1-0204-4623-aa08-cd3f78da2edc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:22.986631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62897e1-0204-4623-aa08-cd3f78da2edc None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:22.992040 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 460/916] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 3 09:48:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:22.998113 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67c82e-e0d5-4748-b0bd-c5ec46e06c7a None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:23.099105 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67c82e-e0d5-4748-b0bd-c5ec46e06c7a None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:23.131959 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ec64d-07c1-41b8-8bb8-cb96097ddc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:23.132837 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ec64d-07c1-41b8-8bb8-cb96097ddc37 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:23.133117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ec64d-07c1-41b8-8bb8-cb96097ddc37 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:23.133696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ec64d-07c1-41b8-8bb8-cb96097ddc37 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:23.134428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ec64d-07c1-41b8-8bb8-cb96097ddc37 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:23.134728 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ec64d-07c1-41b8-8bb8-cb96097ddc37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:23.136083 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ec64d-07c1-41b8-8bb8-cb96097ddc37 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:23.141410 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 457/917] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 3 09:48:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:23.147102 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62897e1-0204-4623-aa08-cd3f78da2edc None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:23.248302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62897e1-0204-4623-aa08-cd3f78da2edc None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:23.281565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e6197-fde6-414e-bc3f-ba16b3a2142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:23.282294 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e6197-fde6-414e-bc3f-ba16b3a2142a None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:23.282575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e6197-fde6-414e-bc3f-ba16b3a2142a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:23.282846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e6197-fde6-414e-bc3f-ba16b3a2142a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:23.283593 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e6197-fde6-414e-bc3f-ba16b3a2142a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:23.287167 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e6197-fde6-414e-bc3f-ba16b3a2142a None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:23.308353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 461/918] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 3 09:48:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:48:23.774514 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d27a51-4b91-4c0c-b853-a039a5b99dcf None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:23.775084 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d27a51-4b91-4c0c-b853-a039a5b99dcf None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:23.775084 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d27a51-4b91-4c0c-b853-a039a5b99dcf None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:23.776656 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 458/919] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:23.781935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819dfdf-7824-4f3d-9d15-5e76f7faa346 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:23.782316 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819dfdf-7824-4f3d-9d15-5e76f7faa346 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:23.782479 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819dfdf-7824-4f3d-9d15-5e76f7faa346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:23.799476 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-4819dfdf-7824-4f3d-9d15-5e76f7faa346 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:23.800653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-4819dfdf-7824-4f3d-9d15-5e76f7faa346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:23.872590 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 462/920] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:48:23.896217 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d27a51-4b91-4c0c-b853-a039a5b99dcf None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:23.996737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d27a51-4b91-4c0c-b853-a039a5b99dcf None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:24.034076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149cba1-eb55-473f-8c96-3f70c7e5d5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:24.034879 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149cba1-eb55-473f-8c96-3f70c7e5d5fc None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:24.035155 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149cba1-eb55-473f-8c96-3f70c7e5d5fc None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:24.035422 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149cba1-eb55-473f-8c96-3f70c7e5d5fc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:24.036074 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149cba1-eb55-473f-8c96-3f70c7e5d5fc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:24.037433 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149cba1-eb55-473f-8c96-3f70c7e5d5fc None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:24.049444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-6149cba1-eb55-473f-8c96-3f70c7e5d5fc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 09:48:24.049444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:24.049444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:24.049444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:24.049444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:24.049444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:24.049444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:24.049444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:24.049444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 09:48:24.049444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:24.049444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:24.049444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:24.049444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:24.049444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:24.049444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:24.049444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:24.049444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:24.050465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:24.050465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:24.050465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:24.050465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:24.050465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:24.050465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:24.050465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:24.050465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:24.050465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:24.050465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:24.050465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:24.050465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:24.050465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:24.050465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:24.050465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:24.050465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:24.051337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:24.051337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:24.051337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:24.051337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:24.051337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:24.051337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:24.051337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:24.051337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:24.051337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:24.051337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:24.051337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:24.051337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:24.051337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 09:48:24.051337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:24.051337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 459/921] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:48:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:24.056717 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819dfdf-7824-4f3d-9d15-5e76f7faa346 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:24.156478 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819dfdf-7824-4f3d-9d15-5e76f7faa346 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:24.189817 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04086e-6764-4af6-9d01-3e1199217759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:24.190491 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04086e-6764-4af6-9d01-3e1199217759 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:24.190771 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04086e-6764-4af6-9d01-3e1199217759 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:24.191043 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04086e-6764-4af6-9d01-3e1199217759 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:24.191752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04086e-6764-4af6-9d01-3e1199217759 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:24.192053 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04086e-6764-4af6-9d01-3e1199217759 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:24.193418 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04086e-6764-4af6-9d01-3e1199217759 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:24.198578 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 463/922] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:48:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:24.204255 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149cba1-eb55-473f-8c96-3f70c7e5d5fc None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:24.311493 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149cba1-eb55-473f-8c96-3f70c7e5d5fc None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:24.346117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895a7b2-bbba-4090-bed9-6f874d8599e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:24.346784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895a7b2-bbba-4090-bed9-6f874d8599e8 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:24.347069 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895a7b2-bbba-4090-bed9-6f874d8599e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:24.347341 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895a7b2-bbba-4090-bed9-6f874d8599e8 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:24.348050 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895a7b2-bbba-4090-bed9-6f874d8599e8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:24.348354 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895a7b2-bbba-4090-bed9-6f874d8599e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:24.349722 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895a7b2-bbba-4090-bed9-6f874d8599e8 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:24.355866 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 460/923] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 3 09:48:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:24.361059 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04086e-6764-4af6-9d01-3e1199217759 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:24.460208 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04086e-6764-4af6-9d01-3e1199217759 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:24.494671 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44603a5d-2aad-4447-bf70-2452c25ebf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:24.495344 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44603a5d-2aad-4447-bf70-2452c25ebf13 None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:24.495625 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44603a5d-2aad-4447-bf70-2452c25ebf13 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:24.495902 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44603a5d-2aad-4447-bf70-2452c25ebf13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:24.496663 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44603a5d-2aad-4447-bf70-2452c25ebf13 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:24.498079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44603a5d-2aad-4447-bf70-2452c25ebf13 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:24.519964 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 464/924] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 3 09:48:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:48:24.753443 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae6144-2592-4d84-9fb9-3e25c7283afd None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:24.753628 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae6144-2592-4d84-9fb9-3e25c7283afd None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:24.753925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae6144-2592-4d84-9fb9-3e25c7283afd None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:24.755530 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 461/925] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:24.761262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab98996-6978-4709-9dd9-70fc9c02dbfe None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:24.761554 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab98996-6978-4709-9dd9-70fc9c02dbfe None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:24.761859 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab98996-6978-4709-9dd9-70fc9c02dbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:24.778639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-cab98996-6978-4709-9dd9-70fc9c02dbfe None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:24.779794 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-cab98996-6978-4709-9dd9-70fc9c02dbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:24.848671 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 465/926] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:24.871119 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae6144-2592-4d84-9fb9-3e25c7283afd None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:24.979727 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae6144-2592-4d84-9fb9-3e25c7283afd None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:25.012845 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10cf68-7327-4784-8412-824e0568830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:25.013580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10cf68-7327-4784-8412-824e0568830c None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:25.013883 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10cf68-7327-4784-8412-824e0568830c None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:25.014156 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10cf68-7327-4784-8412-824e0568830c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:25.031437 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10cf68-7327-4784-8412-824e0568830c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:48:25.039641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-ed10cf68-7327-4784-8412-824e0568830c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 09:48:25.039641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:25.039641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:25.039641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:25.039641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:25.039641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:25.039641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:25.039641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:25.039641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:25.039641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:25.039641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:25.039641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:25.039641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:48:25.039641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:48:25.039641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:48:25.039641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:48:25.040570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:48:25.040570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:48:25.040570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:48:25.040570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:48:25.040570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:25.040570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:25.040570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:25.040570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:25.040570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:25.040570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:25.040570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:25.040570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:25.040570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:25.040570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:25.040570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:25.040570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:25.041429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:25.041429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:25.041429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:25.041429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:25.041429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:48:25.041429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:48:25.041429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:48:25.041429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:48:25.041429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:48:25.041429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:48:25.041429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 09:48:25.041429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:25.041429 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 462/927] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 3 09:48:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:25.046948 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab98996-6978-4709-9dd9-70fc9c02dbfe None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:25.119049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44f598-b198-4fe6-b489-d22370a5fd45 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:25.119412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44f598-b198-4fe6-b489-d22370a5fd45 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:25.119573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44f598-b198-4fe6-b489-d22370a5fd45 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:25.121208 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 463/928] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:48:25.126187 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64294547-2b73-4f76-9aad-c867006463d1 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:25.126466 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64294547-2b73-4f76-9aad-c867006463d1 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:25.126738 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64294547-2b73-4f76-9aad-c867006463d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:25.142267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab98996-6978-4709-9dd9-70fc9c02dbfe None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:25.145186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-64294547-2b73-4f76-9aad-c867006463d1 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:25.146371 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-64294547-2b73-4f76-9aad-c867006463d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:25.181870 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b556d5-0443-420a-804e-153848fc581b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:25.182919 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b556d5-0443-420a-804e-153848fc581b None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:25.183419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b556d5-0443-420a-804e-153848fc581b None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:25.183895 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b556d5-0443-420a-804e-153848fc581b None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:25.185267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b556d5-0443-420a-804e-153848fc581b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:25.185770 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b556d5-0443-420a-804e-153848fc581b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:25.187707 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b556d5-0443-420a-804e-153848fc581b None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:25.198289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 466/929] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 3 09:48:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:25.206762 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b556d5-0443-420a-804e-153848fc581b None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:25.219080 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 464/930] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:48:25.241532 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64294547-2b73-4f76-9aad-c867006463d1 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:25.318652 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b556d5-0443-420a-804e-153848fc581b None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:25.353144 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0f27d-f962-4747-ac54-82eed0187460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:25.353978 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0f27d-f962-4747-ac54-82eed0187460 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:25.354254 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0f27d-f962-4747-ac54-82eed0187460 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:25.354524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0f27d-f962-4747-ac54-82eed0187460 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:25.365017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0f27d-f962-4747-ac54-82eed0187460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:25.366591 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0f27d-f962-4747-ac54-82eed0187460 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:25.371961 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64294547-2b73-4f76-9aad-c867006463d1 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:25.388552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-96d0f27d-f962-4747-ac54-82eed0187460 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:25.388552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:25.388552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:25.388552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:25.388552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:25.388552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:25.388552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:25.388552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:25.388552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:25.388552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:25.388552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:25.388552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:25.388552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:25.388552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:25.388552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:25.389525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:25.389525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:25.389525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:25.389525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:25.389525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:25.389525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:25.389525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:25.389525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:25.389525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:25.389525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:25.389525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:25.389525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:25.389525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:25.389525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:25.389525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:25.389525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:25.389525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:25.390463 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:25.390463 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:25.390463 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:25.390463 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:25.390463 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 467/931] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:25.396143 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0f27d-f962-4747-ac54-82eed0187460 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:25.415789 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88103d0-6d7d-4470-9926-2cbaaaf3edd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:25.416757 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88103d0-6d7d-4470-9926-2cbaaaf3edd2 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:25.416869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88103d0-6d7d-4470-9926-2cbaaaf3edd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:25.417139 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88103d0-6d7d-4470-9926-2cbaaaf3edd2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:25.417825 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88103d0-6d7d-4470-9926-2cbaaaf3edd2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:25.419195 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88103d0-6d7d-4470-9926-2cbaaaf3edd2 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:25.431046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-a88103d0-6d7d-4470-9926-2cbaaaf3edd2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 09:48:25.431046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:25.431046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:25.431046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:25.431046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:25.431046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:25.431046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:25.431046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:25.431046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 09:48:25.431046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:25.431046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:25.431046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:25.431046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:25.431046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:25.431046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:25.431046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:25.431046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:25.432095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:25.432095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:25.432095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:25.432095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:25.432095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:25.432095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:25.432095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:25.432095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:25.432095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:25.432095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:25.432095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:25.432095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:25.432095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:25.432095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:25.432095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:25.432095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:25.432925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:25.432925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:25.432925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:25.432925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:25.432925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:25.432925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:25.432925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:25.432925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:25.432925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:25.432925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:25.432925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:25.432925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:25.432925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 09:48:25.432925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:25.432925 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 465/932] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 3 09:48:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:25.438049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88103d0-6d7d-4470-9926-2cbaaaf3edd2 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:25.509069 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0f27d-f962-4747-ac54-82eed0187460 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:25.539942 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88103d0-6d7d-4470-9926-2cbaaaf3edd2 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:25.543178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a000c-2e09-45fb-8bd0-353a8f624b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:25.543358 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a000c-2e09-45fb-8bd0-353a8f624b11 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:25.543734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a000c-2e09-45fb-8bd0-353a8f624b11 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:25.544101 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a000c-2e09-45fb-8bd0-353a8f624b11 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:25.544914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a000c-2e09-45fb-8bd0-353a8f624b11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:25.545322 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a000c-2e09-45fb-8bd0-353a8f624b11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:25.546833 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a000c-2e09-45fb-8bd0-353a8f624b11 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:25.563638 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 468/933] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:25.564728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a000c-2e09-45fb-8bd0-353a8f624b11 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:25.580916 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cede96-53b7-49b4-952f-c3713e2a3d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:25.581641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cede96-53b7-49b4-952f-c3713e2a3d67 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:25.581966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cede96-53b7-49b4-952f-c3713e2a3d67 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:25.582258 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cede96-53b7-49b4-952f-c3713e2a3d67 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:25.583244 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cede96-53b7-49b4-952f-c3713e2a3d67 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:25.583548 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cede96-53b7-49b4-952f-c3713e2a3d67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:25.585134 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cede96-53b7-49b4-952f-c3713e2a3d67 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:25.591588 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 466/934] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 3 09:48:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:25.596909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cede96-53b7-49b4-952f-c3713e2a3d67 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:25.679130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a000c-2e09-45fb-8bd0-353a8f624b11 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:25.702110 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cede96-53b7-49b4-952f-c3713e2a3d67 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:25.712513 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26591259-d57e-49ec-be77-0a28751d8ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:25.713508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26591259-d57e-49ec-be77-0a28751d8ab2 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:25.713951 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26591259-d57e-49ec-be77-0a28751d8ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:25.714383 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26591259-d57e-49ec-be77-0a28751d8ab2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:25.721869 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26591259-d57e-49ec-be77-0a28751d8ab2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:25.723294 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26591259-d57e-49ec-be77-0a28751d8ab2 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:25.733990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64718b4-0531-4cb1-b1b0-715f0b5b0ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:25.734775 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64718b4-0531-4cb1-b1b0-715f0b5b0ca7 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:25.735092 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64718b4-0531-4cb1-b1b0-715f0b5b0ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:25.735347 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64718b4-0531-4cb1-b1b0-715f0b5b0ca7 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:25.736159 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64718b4-0531-4cb1-b1b0-715f0b5b0ca7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:25.736489 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64718b4-0531-4cb1-b1b0-715f0b5b0ca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:25.738058 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64718b4-0531-4cb1-b1b0-715f0b5b0ca7 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:25.738933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-26591259-d57e-49ec-be77-0a28751d8ab2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 09:48:25.738933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:25.738933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:25.738933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:25.738933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:25.738933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:25.738933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:25.738933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:25.738933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:25.738933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:25.738933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:25.738933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:25.738933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:48:25.738933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:48:25.738933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:48:25.738933 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:25.739958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:25.740976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:25.740976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:25.740976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:48:25.740976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:48:25.740976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:48:25.740976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:48:25.740976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:48:25.740976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:48:25.740976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 09:48:25.740976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:25.740976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 469/935] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 3 09:48:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:25.742344 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6df846-416f-41b7-b9d1-31202cad5d0c None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:25.742344 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6df846-416f-41b7-b9d1-31202cad5d0c None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:25.742344 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6df846-416f-41b7-b9d1-31202cad5d0c None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:25.747767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 470/936] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:25.747767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6df846-416f-41b7-b9d1-31202cad5d0c None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:25.757251 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 467/937] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 3 09:48:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:25.757251 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a618bb-4b08-42f5-9711-6965483c7e75 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:25.757251 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a618bb-4b08-42f5-9711-6965483c7e75 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:25.757251 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a618bb-4b08-42f5-9711-6965483c7e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:25.771164 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-51a618bb-4b08-42f5-9711-6965483c7e75 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:25.772339 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-51a618bb-4b08-42f5-9711-6965483c7e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:25.836114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 468/938] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:25.837019 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a618bb-4b08-42f5-9711-6965483c7e75 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:25.851688 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6df846-416f-41b7-b9d1-31202cad5d0c None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:25.888780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d9c65-0c43-47f5-9dab-8ace4fe74641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:25.889438 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d9c65-0c43-47f5-9dab-8ace4fe74641 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:25.889706 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d9c65-0c43-47f5-9dab-8ace4fe74641 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:25.890010 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d9c65-0c43-47f5-9dab-8ace4fe74641 None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:25.890845 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d9c65-0c43-47f5-9dab-8ace4fe74641 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:25.891148 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d9c65-0c43-47f5-9dab-8ace4fe74641 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:25.892622 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d9c65-0c43-47f5-9dab-8ace4fe74641 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:25.913747 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 471/939] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 3 09:48:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:25.913747 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d9c65-0c43-47f5-9dab-8ace4fe74641 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:25.938498 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a618bb-4b08-42f5-9711-6965483c7e75 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:25.972012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb7b55-cf1b-4586-86d0-9697b2106df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:25.972659 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb7b55-cf1b-4586-86d0-9697b2106df1 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:25.972934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb7b55-cf1b-4586-86d0-9697b2106df1 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:25.973202 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb7b55-cf1b-4586-86d0-9697b2106df1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:25.974006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb7b55-cf1b-4586-86d0-9697b2106df1 None admin] RBAC: Adding query filter params (interface=public, service_id=bb5376744d3940ce9ac9de46148324e3, region_id=RegionOne) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:25.974312 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb7b55-cf1b-4586-86d0-9697b2106df1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:25.975660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb7b55-cf1b-4586-86d0-9697b2106df1 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:25.984997 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 469/940] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 3 09:48:25 2022] GET /identity/v3/endpoints?service_id=bb5376744d3940ce9ac9de46148324e3&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:25.984997 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb7b55-cf1b-4586-86d0-9697b2106df1 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:26.010752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d9c65-0c43-47f5-9dab-8ace4fe74641 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:26.044877 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31119961-f054-43c7-8d33-cc464fc5c680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:26.046371 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31119961-f054-43c7-8d33-cc464fc5c680 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:26.047069 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31119961-f054-43c7-8d33-cc464fc5c680 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:26.047501 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31119961-f054-43c7-8d33-cc464fc5c680 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:26.048451 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31119961-f054-43c7-8d33-cc464fc5c680 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:26.050475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31119961-f054-43c7-8d33-cc464fc5c680 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:26.065107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-31119961-f054-43c7-8d33-cc464fc5c680 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 09:48:26.065107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:26.065107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:26.065107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:26.065107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:26.065107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:26.065107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:26.065107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:26.065107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 09:48:26.065107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:26.065107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:26.065107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:26.065107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:26.065107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:26.065107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:26.065107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:26.065107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:26.066268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:26.066268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:26.066268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:26.066268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:26.066268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:26.066268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:26.066268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:26.066268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:26.066268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:26.066268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:26.066268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:26.066268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:26.066268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:26.066268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:26.066268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:26.066268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:26.067121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:26.067121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:26.067121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:26.067121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:26.067121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:26.067121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:26.067121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:26.067121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:26.067121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:26.067121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:26.067121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:26.067121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:26.067121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 09:48:26.067121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:26.067848 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 472/941] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:26.067926 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31119961-f054-43c7-8d33-cc464fc5c680 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:26.090403 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb7b55-cf1b-4586-86d0-9697b2106df1 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:26.123303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec2cad-832d-4752-b12b-14aa361befc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:26.124120 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec2cad-832d-4752-b12b-14aa361befc2 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:26.124408 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec2cad-832d-4752-b12b-14aa361befc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:26.124741 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec2cad-832d-4752-b12b-14aa361befc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:26.135357 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec2cad-832d-4752-b12b-14aa361befc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:26.136820 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec2cad-832d-4752-b12b-14aa361befc2 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:26.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-92ec2cad-832d-4752-b12b-14aa361befc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:26.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:26.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:26.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:26.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:26.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:26.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:26.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:26.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:26.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:26.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:26.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:26.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:26.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:26.154125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:26.155142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:26.155142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:26.155142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:26.155142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:26.155142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:26.155142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:26.155142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:26.155142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:26.155142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:26.155142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:26.155142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:26.155142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:26.155142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:26.155142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:26.155142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:26.155142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:26.155142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:26.156222 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:26.156222 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:26.156222 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:26.156222 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:26.157734 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 470/942] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:26.158679 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec2cad-832d-4752-b12b-14aa361befc2 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:26.171071 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31119961-f054-43c7-8d33-cc464fc5c680 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:26.208360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54070f63-0cef-4ff3-8268-ff212a8ac0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:26.209027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54070f63-0cef-4ff3-8268-ff212a8ac0be None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:26.209306 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54070f63-0cef-4ff3-8268-ff212a8ac0be None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:26.209580 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54070f63-0cef-4ff3-8268-ff212a8ac0be None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:26.210743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54070f63-0cef-4ff3-8268-ff212a8ac0be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:26.212570 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54070f63-0cef-4ff3-8268-ff212a8ac0be None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:26.218716 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 473/943] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 3 09:48:26 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:48:26.219501 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54070f63-0cef-4ff3-8268-ff212a8ac0be None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:26.280581 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec2cad-832d-4752-b12b-14aa361befc2 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:26.328610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33377a0e-43fb-40ee-8229-a09b9202a6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:26.330262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33377a0e-43fb-40ee-8229-a09b9202a6fd None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:26.331022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33377a0e-43fb-40ee-8229-a09b9202a6fd None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:26.331517 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33377a0e-43fb-40ee-8229-a09b9202a6fd None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:26.332945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33377a0e-43fb-40ee-8229-a09b9202a6fd None admin] RBAC: Adding query filter params (name=compute) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:26.333474 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33377a0e-43fb-40ee-8229-a09b9202a6fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:26.335514 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33377a0e-43fb-40ee-8229-a09b9202a6fd None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:26.341677 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54070f63-0cef-4ff3-8268-ff212a8ac0be None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:26.343174 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 471/944] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 3 09:48:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:26.348742 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33377a0e-43fb-40ee-8229-a09b9202a6fd None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:26.384007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe95b4-a94f-4784-b38c-407834c6f05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:26.385114 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe95b4-a94f-4784-b38c-407834c6f05e None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:26.385642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe95b4-a94f-4784-b38c-407834c6f05e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:26.386192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe95b4-a94f-4784-b38c-407834c6f05e None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:26.387113 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe95b4-a94f-4784-b38c-407834c6f05e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:26.387620 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe95b4-a94f-4784-b38c-407834c6f05e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:26.389308 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe95b4-a94f-4784-b38c-407834c6f05e None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:26.407575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 474/945] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:26.408949 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe95b4-a94f-4784-b38c-407834c6f05e None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:26.458423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33377a0e-43fb-40ee-8229-a09b9202a6fd None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:26.494741 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed83d81-96f6-4557-8491-c2d42e34b91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:26.495770 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed83d81-96f6-4557-8491-c2d42e34b91d None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:26.496262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed83d81-96f6-4557-8491-c2d42e34b91d None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:26.496737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed83d81-96f6-4557-8491-c2d42e34b91d None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:26.497636 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed83d81-96f6-4557-8491-c2d42e34b91d None admin] RBAC: Adding query filter params (type=compute) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:26.498152 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed83d81-96f6-4557-8491-c2d42e34b91d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:26.499713 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed83d81-96f6-4557-8491-c2d42e34b91d None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:26.504923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 472/946] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 3 09:48:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:26.510492 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe95b4-a94f-4784-b38c-407834c6f05e None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:26.549088 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cddff-67f7-4f08-ae88-e47a4e2ec183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:26.550286 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cddff-67f7-4f08-ae88-e47a4e2ec183 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:26.550759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cddff-67f7-4f08-ae88-e47a4e2ec183 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:26.551219 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cddff-67f7-4f08-ae88-e47a4e2ec183 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:26.559618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cddff-67f7-4f08-ae88-e47a4e2ec183 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:26.561574 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cddff-67f7-4f08-ae88-e47a4e2ec183 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:26.577558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-ba5cddff-67f7-4f08-ae88-e47a4e2ec183 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:26.577558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:26.577558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:26.577558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:26.577558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:26.577558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:26.577558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:26.577558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:26.577558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:26.577558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:26.577558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:26.577558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:26.577558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:48:26.577558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:48:26.577558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:48:26.578659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:48:26.578659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:26.578659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:26.578659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:26.578659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:26.578659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:26.578659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:26.578659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:26.578659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:26.578659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:26.578659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:26.578659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:26.578659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:26.578659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:26.578659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:26.578659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:26.578659 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:26.579536 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:48:26.579536 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:48:26.579536 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:48:26.579536 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:48:26.579536 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:48:26.579536 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:48:26.579536 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:26.579536 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:26.582131 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 475/947] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:26.588822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed83d81-96f6-4557-8491-c2d42e34b91d None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:26.694848 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed83d81-96f6-4557-8491-c2d42e34b91d None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:26.731786 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542596f4-ef76-4a6d-a5fd-f5fb7226d869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:26.732450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542596f4-ef76-4a6d-a5fd-f5fb7226d869 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:26.732724 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542596f4-ef76-4a6d-a5fd-f5fb7226d869 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:26.732996 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542596f4-ef76-4a6d-a5fd-f5fb7226d869 None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:26.733861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542596f4-ef76-4a6d-a5fd-f5fb7226d869 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:26.734169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542596f4-ef76-4a6d-a5fd-f5fb7226d869 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:26.735635 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542596f4-ef76-4a6d-a5fd-f5fb7226d869 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:26.747989 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 473/948] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:48:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:26.753847 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cddff-67f7-4f08-ae88-e47a4e2ec183 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:26.852072 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cddff-67f7-4f08-ae88-e47a4e2ec183 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:26.885586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9d40e-acc3-4e65-80a5-e413e30b6f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:26.887578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937a827-3125-4691-b50b-e5c1bde13a1b None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:26.887861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937a827-3125-4691-b50b-e5c1bde13a1b None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:26.888131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937a827-3125-4691-b50b-e5c1bde13a1b None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:26.889511 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 474/949] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:48:26.890084 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9d40e-acc3-4e65-80a5-e413e30b6f9c None admin] REQUEST_METHOD: `PUT` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:26.890356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9d40e-acc3-4e65-80a5-e413e30b6f9c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:26.890622 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9d40e-acc3-4e65-80a5-e413e30b6f9c None admin] PATH_INFO: `/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/62b336ab0cfd4bfd9ec498dcd940332f/roles/97c22875d1454453affa45b653c6eeed` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:26.892782 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9d40e-acc3-4e65-80a5-e413e30b6f9c None admin] RBAC: Authorizing `identity:create_grant(project_id=f395f4842c39422d962dbddc4cf2897a, user_id=62b336ab0cfd4bfd9ec498dcd940332f, role_id=97c22875d1454453affa45b653c6eeed)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:26.894229 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9d40e-acc3-4e65-80a5-e413e30b6f9c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:26.894865 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e6f1b-d96c-4168-af1e-e72283c4c301 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:26.895151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e6f1b-d96c-4168-af1e-e72283c4c301 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:26.895427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e6f1b-d96c-4168-af1e-e72283c4c301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:26.911586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 476/950] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:48:26 2022] PUT /identity/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/62b336ab0cfd4bfd9ec498dcd940332f/roles/97c22875d1454453affa45b653c6eeed => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:48:26.927027 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-8c4e6f1b-d96c-4168-af1e-e72283c4c301 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:26.928227 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-8c4e6f1b-d96c-4168-af1e-e72283c4c301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:27.003759 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 475/951] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:48:27.027418 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9d40e-acc3-4e65-80a5-e413e30b6f9c None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:27.141827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9d40e-acc3-4e65-80a5-e413e30b6f9c None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:27.175827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045f100-37ad-49a0-ab70-3c7bf0d7d200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:27.176488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045f100-37ad-49a0-ab70-3c7bf0d7d200 None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:27.176765 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045f100-37ad-49a0-ab70-3c7bf0d7d200 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:27.177032 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045f100-37ad-49a0-ab70-3c7bf0d7d200 None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:27.177747 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045f100-37ad-49a0-ab70-3c7bf0d7d200 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:27.179215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045f100-37ad-49a0-ab70-3c7bf0d7d200 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:27.180778 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: WARNING keystone.server.flask.common [None req-8045f100-37ad-49a0-ab70-3c7bf0d7d200 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 03 09:48:27.201276 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.sql.core [None req-8045f100-37ad-49a0-ab70-3c7bf0d7d200 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 09:48:27.201276 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 03 09:48:27.201276 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [parameters: {'id': 'b1a633bf6b7b4cee90388d29bed239d4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 03 09:48:27.201276 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79789) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 09:48:27.218733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-8045f100-37ad-49a0-ab70-3c7bf0d7d200 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b1a633bf6b7b4cee90388d29bed239d4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b1a633bf6b7b4cee90388d29bed239d4. May 03 09:48:27.218733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:27.218733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 09:48:27.218733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 09:48:27.218733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 09:48:27.218733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 09:48:27.218733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 09:48:27.218733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application result = self._query(query) May 03 09:48:27.218733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 09:48:27.218733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application conn.query(q) May 03 09:48:27.218733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 09:48:27.218733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 09:48:27.218733 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application result.read() May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 03 09:48:27.219575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return project_ref.to_dict() May 03 09:48:27.220742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 09:48:27.220742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application next(self.gen) May 03 09:48:27.220742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 09:48:27.220742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application yield resource May 03 09:48:27.220742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 09:48:27.220742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application next(self.gen) May 03 09:48:27.220742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 09:48:27.220742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self.session.rollback() May 03 09:48:27.220742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 09:48:27.220742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self.force_reraise() May 03 09:48:27.220742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 09:48:27.220742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise self.value May 03 09:48:27.220742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 09:48:27.220742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 09:48:27.220742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 09:48:27.220742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application session.commit() May 03 09:48:27.220742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 09:48:27.222216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 09:48:27.222216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 09:48:27.222216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._prepare_impl() May 03 09:48:27.222216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 09:48:27.222216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self.session.flush() May 03 09:48:27.222216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 09:48:27.222216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._flush(objects) May 03 09:48:27.222216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 09:48:27.222216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 09:48:27.222216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 09:48:27.222216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application compat.raise_( May 03 09:48:27.222216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 09:48:27.222216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception May 03 09:48:27.222216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 09:48:27.222216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application flush_context.execute() May 03 09:48:27.222216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 09:48:27.222216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rec.execute(self) May 03 09:48:27.223523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 09:48:27.223523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 09:48:27.223523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 09:48:27.223523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 09:48:27.223523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 03 09:48:27.223523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application c = connection._execute_20( May 03 09:48:27.223523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 09:48:27.223523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 09:48:27.223523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 09:48:27.223523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 09:48:27.223523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 09:48:27.223523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 09:48:27.223523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 09:48:27.223523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 09:48:27.223523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 09:48:27.224472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 09:48:27.224472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 09:48:27.224472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception May 03 09:48:27.224472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 09:48:27.224472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 09:48:27.224472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 09:48:27.224472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 09:48:27.224472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 09:48:27.224472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application result = self._query(query) May 03 09:48:27.224472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 09:48:27.224472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application conn.query(q) May 03 09:48:27.224472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 09:48:27.224472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 09:48:27.224472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 09:48:27.224472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application result.read() May 03 09:48:27.224472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 09:48:27.224472 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 09:48:27.231619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 09:48:27.231619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 09:48:27.231619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 09:48:27.231619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 09:48:27.231619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 09:48:27.231619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 09:48:27.231619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 09:48:27.231619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 03 09:48:27.231619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [parameters: {'id': 'b1a633bf6b7b4cee90388d29bed239d4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 03 09:48:27.231619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 09:48:27.231619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:27.231619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:27.231619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:27.231619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:27.231619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 03 09:48:27.233447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 03 09:48:27.233447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 09:48:27.233447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 09:48:27.233447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 03 09:48:27.233447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:27.233447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:27.233447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:27.233447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:27.233447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:27.233447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:27.233447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:27.233447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:27.233447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:27.233447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:27.233447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:27.233447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:27.233447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:27.235572 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:27.235572 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 03 09:48:27.235572 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 03 09:48:27.235572 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:27.235572 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:27.235572 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 03 09:48:27.235572 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.Conflict( May 03 09:48:27.235572 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b1a633bf6b7b4cee90388d29bed239d4. May 03 09:48:27.235572 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:27.235572 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 477/952] 10.222.0.55 () {60 vars in 1140 bytes} [Tue May 3 09:48:27 2022] POST /identity/v3/projects => generated 262 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:27.236782 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e6f1b-d96c-4168-af1e-e72283c4c301 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:27.325810 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e6f1b-d96c-4168-af1e-e72283c4c301 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:27.360164 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc636fa5-991d-4e20-ad31-ac17907024b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:27.360956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc636fa5-991d-4e20-ad31-ac17907024b5 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:27.361231 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc636fa5-991d-4e20-ad31-ac17907024b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:27.361498 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc636fa5-991d-4e20-ad31-ac17907024b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:27.368547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc636fa5-991d-4e20-ad31-ac17907024b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:27.370003 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc636fa5-991d-4e20-ad31-ac17907024b5 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:27.384480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-fc636fa5-991d-4e20-ad31-ac17907024b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:27.384480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:27.384480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:27.384480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:27.384480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:27.384480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:27.384480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:27.384480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:27.384480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:27.384480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:27.384480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:27.384480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:27.384480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:48:27.384480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:48:27.384480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:48:27.385404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:48:27.385404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:27.385404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:27.385404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:27.385404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:27.385404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:27.385404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:27.385404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:27.385404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:27.385404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:27.385404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:27.385404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:27.385404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:27.385404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:27.385404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:27.385404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:27.385404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:27.386908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:48:27.386908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:48:27.386908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:48:27.386908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:48:27.386908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:48:27.386908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:48:27.386908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:27.386908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:27.386908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 476/953] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:27.391762 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045f100-37ad-49a0-ab70-3c7bf0d7d200 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:27.497317 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045f100-37ad-49a0-ab70-3c7bf0d7d200 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:27.530071 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dfd2a-c6d9-4605-a5ac-3e483516dd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:27.530724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dfd2a-c6d9-4605-a5ac-3e483516dd28 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:27.531000 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dfd2a-c6d9-4605-a5ac-3e483516dd28 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:27.531272 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dfd2a-c6d9-4605-a5ac-3e483516dd28 None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:27.532074 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dfd2a-c6d9-4605-a5ac-3e483516dd28 None admin] RBAC: Adding query filter params (name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:27.532381 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dfd2a-c6d9-4605-a5ac-3e483516dd28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:27.534014 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dfd2a-c6d9-4605-a5ac-3e483516dd28 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:27.553964 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 478/954] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 3 09:48:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:28.565301 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9e428-768c-408e-8ab3-80d61b08e974 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:28.566005 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9e428-768c-408e-8ab3-80d61b08e974 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:28.566005 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9e428-768c-408e-8ab3-80d61b08e974 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:28.567377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 477/955] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:28.573264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58f7d7-07d9-4099-9103-2e2b6bfe9898 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:28.574177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58f7d7-07d9-4099-9103-2e2b6bfe9898 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:28.574647 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58f7d7-07d9-4099-9103-2e2b6bfe9898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:28.596612 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-4d58f7d7-07d9-4099-9103-2e2b6bfe9898 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:28.599407 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-4d58f7d7-07d9-4099-9103-2e2b6bfe9898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:28.671042 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 479/956] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:28.695497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9e428-768c-408e-8ab3-80d61b08e974 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:28.804899 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9e428-768c-408e-8ab3-80d61b08e974 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:28.840305 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6745c7c-b066-492c-a859-79baa5b6a16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:28.841463 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6745c7c-b066-492c-a859-79baa5b6a16e None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:28.841987 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6745c7c-b066-492c-a859-79baa5b6a16e None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:28.842450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6745c7c-b066-492c-a859-79baa5b6a16e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:28.843314 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6745c7c-b066-492c-a859-79baa5b6a16e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:28.844890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6745c7c-b066-492c-a859-79baa5b6a16e None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:28.857540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-c6745c7c-b066-492c-a859-79baa5b6a16e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 09:48:28.857540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:28.857540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:28.857540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:28.857540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:28.857540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:28.857540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:28.857540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:28.857540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 09:48:28.857540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:28.857540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:28.857540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:28.857540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:28.857540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:28.857540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:28.857540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:28.857540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:28.858650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:28.858650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:28.858650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:28.858650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:28.858650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:28.858650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:28.858650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:28.858650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:28.858650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:28.858650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:28.858650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:28.858650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:28.858650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:28.858650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:28.858650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:28.858650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:28.859480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:28.859480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:28.859480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:28.859480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:28.859480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:28.859480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:28.859480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:28.859480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:28.859480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:28.859480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:28.859480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:28.859480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:28.859480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 09:48:28.859480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:28.862437 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 478/957] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 3 09:48:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:28.869359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58f7d7-07d9-4099-9103-2e2b6bfe9898 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:28.905018 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ac7b0-cfb5-4665-adf7-0f42bfff837b None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:28.905699 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ac7b0-cfb5-4665-adf7-0f42bfff837b None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:28.906205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ac7b0-cfb5-4665-adf7-0f42bfff837b None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:28.908013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 479/958] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:28.915334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b666e-0088-48ea-b669-b20ed5538c43 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:28.915904 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b666e-0088-48ea-b669-b20ed5538c43 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:28.916352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b666e-0088-48ea-b669-b20ed5538c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:28.934772 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-e69b666e-0088-48ea-b669-b20ed5538c43 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:28.936206 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-e69b666e-0088-48ea-b669-b20ed5538c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:28.981594 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58f7d7-07d9-4099-9103-2e2b6bfe9898 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:29.019324 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 480/959] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:48:29.024874 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c94972-3c21-4673-bca4-ed7deb0d571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:29.025872 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c94972-3c21-4673-bca4-ed7deb0d571e None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:29.026327 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c94972-3c21-4673-bca4-ed7deb0d571e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:29.026800 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c94972-3c21-4673-bca4-ed7deb0d571e None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:29.027768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c94972-3c21-4673-bca4-ed7deb0d571e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:29.028437 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c94972-3c21-4673-bca4-ed7deb0d571e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:29.030007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c94972-3c21-4673-bca4-ed7deb0d571e None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:29.036017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 480/960] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 3 09:48:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:29.042326 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b666e-0088-48ea-b669-b20ed5538c43 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:29.046904 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c94972-3c21-4673-bca4-ed7deb0d571e None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:29.165450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b666e-0088-48ea-b669-b20ed5538c43 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:29.181463 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c94972-3c21-4673-bca4-ed7deb0d571e None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:29.213501 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7abaf-15f8-4c1b-b051-61313ebe382c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:29.214586 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7abaf-15f8-4c1b-b051-61313ebe382c None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:29.215046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7abaf-15f8-4c1b-b051-61313ebe382c None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:29.215490 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7abaf-15f8-4c1b-b051-61313ebe382c None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:29.216373 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7abaf-15f8-4c1b-b051-61313ebe382c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:29.216848 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7abaf-15f8-4c1b-b051-61313ebe382c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:29.218470 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7abaf-15f8-4c1b-b051-61313ebe382c None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:29.224706 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 481/961] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 3 09:48:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:29.229347 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374abd7-73ee-455d-a808-f6fc0059fe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:29.230772 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7abaf-15f8-4c1b-b051-61313ebe382c None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:29.231783 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374abd7-73ee-455d-a808-f6fc0059fe76 None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:29.232122 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374abd7-73ee-455d-a808-f6fc0059fe76 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:29.232376 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374abd7-73ee-455d-a808-f6fc0059fe76 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:29.233045 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374abd7-73ee-455d-a808-f6fc0059fe76 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:29.234500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374abd7-73ee-455d-a808-f6fc0059fe76 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:29.257992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 481/962] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 3 09:48:29 2022] POST /identity/v3/services => generated 242 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:48:29.390611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7abaf-15f8-4c1b-b051-61313ebe382c None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:29.393097 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc707c09-b62b-4663-b877-463fe6c36758 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:29.393672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc707c09-b62b-4663-b877-463fe6c36758 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:29.394198 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc707c09-b62b-4663-b877-463fe6c36758 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:29.396497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 482/963] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:29.404790 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190b9e9-72c4-4abf-830b-81fc86ca7556 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:29.405275 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190b9e9-72c4-4abf-830b-81fc86ca7556 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:29.406492 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190b9e9-72c4-4abf-830b-81fc86ca7556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:29.432983 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-7190b9e9-72c4-4abf-830b-81fc86ca7556 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:29.434447 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-7190b9e9-72c4-4abf-830b-81fc86ca7556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:29.450586 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4c373-d0d0-49d4-967f-927c00590418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:29.451676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4c373-d0d0-49d4-967f-927c00590418 None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:29.452190 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4c373-d0d0-49d4-967f-927c00590418 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:29.452678 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4c373-d0d0-49d4-967f-927c00590418 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:29.453664 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4c373-d0d0-49d4-967f-927c00590418 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:29.455814 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4c373-d0d0-49d4-967f-927c00590418 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:29.484780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 482/964] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 3 09:48:29 2022] POST /identity/v3/endpoints => generated 349 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:48:29.549971 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 483/965] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:48:29.573423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4c373-d0d0-49d4-967f-927c00590418 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:29.681500 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4c373-d0d0-49d4-967f-927c00590418 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:29.718123 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac48141-36e7-4af6-9557-81c1f0448664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:29.718888 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac48141-36e7-4af6-9557-81c1f0448664 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:29.719168 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac48141-36e7-4af6-9557-81c1f0448664 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:29.719441 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac48141-36e7-4af6-9557-81c1f0448664 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:29.732224 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac48141-36e7-4af6-9557-81c1f0448664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:48:29.741280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-aac48141-36e7-4af6-9557-81c1f0448664 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 09:48:29.741280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:29.741280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:29.741280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:29.741280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:29.741280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:29.741280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:29.741280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:29.741280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:29.741280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:29.741280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:29.741280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:29.741280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:48:29.741280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:48:29.741280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:48:29.741280 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:48:29.742446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:48:29.742446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:48:29.742446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:48:29.742446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:48:29.742446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:29.742446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:29.742446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:29.742446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:29.742446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:29.742446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:29.742446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:29.742446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:29.742446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:29.742446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:29.742446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:29.742446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:29.743268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:29.743268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:29.743268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:29.743268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:29.743268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:48:29.743268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:48:29.743268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:48:29.743268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:48:29.743268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:48:29.743268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:48:29.743268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 09:48:29.743268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:29.744039 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 483/966] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 3 09:48:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:29.749357 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190b9e9-72c4-4abf-830b-81fc86ca7556 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:29.845963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190b9e9-72c4-4abf-830b-81fc86ca7556 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:29.884857 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426de9e-a5cb-4aeb-b015-39d378ab3310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:29.885925 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426de9e-a5cb-4aeb-b015-39d378ab3310 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:29.886413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426de9e-a5cb-4aeb-b015-39d378ab3310 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:29.886890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426de9e-a5cb-4aeb-b015-39d378ab3310 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:29.887841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426de9e-a5cb-4aeb-b015-39d378ab3310 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:29.888331 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426de9e-a5cb-4aeb-b015-39d378ab3310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:29.889904 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426de9e-a5cb-4aeb-b015-39d378ab3310 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:29.896135 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005e445-85a5-4050-b81c-de335c89a8c2 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:29.896419 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005e445-85a5-4050-b81c-de335c89a8c2 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:29.896696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005e445-85a5-4050-b81c-de335c89a8c2 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:29.898532 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 484/967] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:29.901483 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 484/968] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 3 09:48:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:29.905852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffd249-2edf-441c-baf7-e35efb341afc None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:29.905852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffd249-2edf-441c-baf7-e35efb341afc None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:29.905852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffd249-2edf-441c-baf7-e35efb341afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:29.907257 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426de9e-a5cb-4aeb-b015-39d378ab3310 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:29.921560 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-bdffd249-2edf-441c-baf7-e35efb341afc None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:29.922871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-bdffd249-2edf-441c-baf7-e35efb341afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:29.992470 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 485/969] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:48:30.020725 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffd249-2edf-441c-baf7-e35efb341afc None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:30.030368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426de9e-a5cb-4aeb-b015-39d378ab3310 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:30.071517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8778ab-edaf-40f9-b1f4-081b9040fa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:30.072342 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8778ab-edaf-40f9-b1f4-081b9040fa00 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:30.072617 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8778ab-edaf-40f9-b1f4-081b9040fa00 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:30.072887 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8778ab-edaf-40f9-b1f4-081b9040fa00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:30.086334 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8778ab-edaf-40f9-b1f4-081b9040fa00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:30.088246 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8778ab-edaf-40f9-b1f4-081b9040fa00 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:30.108927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-ca8778ab-edaf-40f9-b1f4-081b9040fa00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:30.108927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:30.108927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:30.108927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:30.108927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:30.108927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:30.108927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:30.108927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:30.108927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:30.108927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:30.108927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:30.108927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:30.108927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:30.108927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:30.108927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:30.109890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:30.109890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:30.109890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:30.109890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:30.109890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:30.109890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:30.109890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:30.109890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:30.109890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:30.109890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:30.109890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:30.109890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:30.109890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:30.109890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:30.109890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:30.109890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:30.109890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:30.110777 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:30.110777 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:30.110777 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:30.110777 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:30.117672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 485/970] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:30.119410 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8778ab-edaf-40f9-b1f4-081b9040fa00 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:30.121958 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffd249-2edf-441c-baf7-e35efb341afc None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:30.162617 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc227e0-3d9a-4ec6-9380-ef33b9f3a1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:30.164275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc227e0-3d9a-4ec6-9380-ef33b9f3a1bd None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:30.164758 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc227e0-3d9a-4ec6-9380-ef33b9f3a1bd None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:30.165268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc227e0-3d9a-4ec6-9380-ef33b9f3a1bd None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:30.166611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc227e0-3d9a-4ec6-9380-ef33b9f3a1bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:30.168878 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc227e0-3d9a-4ec6-9380-ef33b9f3a1bd None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:30.170960 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: WARNING keystone.server.flask.common [None req-cfc227e0-3d9a-4ec6-9380-ef33b9f3a1bd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 03 09:48:30.186854 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.sql.core [None req-cfc227e0-3d9a-4ec6-9380-ef33b9f3a1bd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 09:48:30.186854 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 03 09:48:30.186854 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [parameters: {'user_id': 'f6e41ccab8274b3eb7402e702fd9ed30', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 03 09:48:30.186854 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79790) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 09:48:30.197460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-cfc227e0-3d9a-4ec6-9380-ef33b9f3a1bd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 03 09:48:30.197460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:30.197460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 09:48:30.197460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 09:48:30.197460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 09:48:30.197460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 09:48:30.197460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 09:48:30.197460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application result = self._query(query) May 03 09:48:30.197460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 09:48:30.197460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application conn.query(q) May 03 09:48:30.197460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 09:48:30.197460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 09:48:30.197460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 09:48:30.197460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application result.read() May 03 09:48:30.197460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 09:48:30.198540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application next(self.gen) May 03 09:48:30.199520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 09:48:30.199520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application yield resource May 03 09:48:30.199520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 09:48:30.199520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application next(self.gen) May 03 09:48:30.199520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 09:48:30.199520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self.session.rollback() May 03 09:48:30.199520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 09:48:30.199520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self.force_reraise() May 03 09:48:30.199520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 09:48:30.199520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise self.value May 03 09:48:30.199520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 09:48:30.199520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 09:48:30.199520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 09:48:30.199520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application session.commit() May 03 09:48:30.199520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 09:48:30.199520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 09:48:30.199520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 09:48:30.200400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._prepare_impl() May 03 09:48:30.200400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 09:48:30.200400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self.session.flush() May 03 09:48:30.200400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 09:48:30.200400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._flush(objects) May 03 09:48:30.200400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 09:48:30.200400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 09:48:30.200400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 09:48:30.200400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application compat.raise_( May 03 09:48:30.200400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 09:48:30.200400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception May 03 09:48:30.200400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 09:48:30.200400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application flush_context.execute() May 03 09:48:30.200400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 09:48:30.200400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rec.execute(self) May 03 09:48:30.200400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 09:48:30.200400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 09:48:30.202107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 09:48:30.202107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 09:48:30.202107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 03 09:48:30.202107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application result = connection._execute_20( May 03 09:48:30.202107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 09:48:30.202107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 09:48:30.202107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 09:48:30.202107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 09:48:30.202107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 09:48:30.202107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 09:48:30.202107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 09:48:30.202107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 09:48:30.202107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 09:48:30.202107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 09:48:30.202107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 09:48:30.202107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception May 03 09:48:30.202969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 09:48:30.202969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 09:48:30.202969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 09:48:30.202969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 09:48:30.202969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 09:48:30.202969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application result = self._query(query) May 03 09:48:30.202969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 09:48:30.202969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application conn.query(q) May 03 09:48:30.202969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 09:48:30.202969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 09:48:30.202969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 09:48:30.202969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application result.read() May 03 09:48:30.202969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 09:48:30.202969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 09:48:30.202969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 09:48:30.202969 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 09:48:30.203823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 09:48:30.203823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 09:48:30.203823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 09:48:30.203823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 09:48:30.203823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 09:48:30.203823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 03 09:48:30.203823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f6e41ccab8274b3eb7402e702fd9ed30', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 03 09:48:30.203823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 09:48:30.203823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:30.203823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:30.203823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:30.203823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:30.203823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:30.203823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:30.203823 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:30.204746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:30.204746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:30.204746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:30.204746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:30.204746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:30.204746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:30.204746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:30.204746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 03 09:48:30.204746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 03 09:48:30.204746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:30.204746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:30.204746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:48:30.204746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:30.204746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:48:30.204746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:30.204746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 03 09:48:30.204746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 03 09:48:30.207658 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 03 09:48:30.207658 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 03 09:48:30.207658 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 09:48:30.207658 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 09:48:30.207658 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 03 09:48:30.207658 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:30.208923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 486/971] 10.222.0.55 () {60 vars in 1131 bytes} [Tue May 3 09:48:30 2022] POST /identity/v3/users => generated 160 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:30.209335 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc227e0-3d9a-4ec6-9380-ef33b9f3a1bd None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:30.235668 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8778ab-edaf-40f9-b1f4-081b9040fa00 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:30.269885 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45175935-312d-4e35-9225-27cdf7b4d9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:30.270493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45175935-312d-4e35-9225-27cdf7b4d9e2 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:30.270756 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45175935-312d-4e35-9225-27cdf7b4d9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:30.271023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45175935-312d-4e35-9225-27cdf7b4d9e2 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:30.271735 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45175935-312d-4e35-9225-27cdf7b4d9e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:30.272332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45175935-312d-4e35-9225-27cdf7b4d9e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:30.273508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45175935-312d-4e35-9225-27cdf7b4d9e2 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:30.290316 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 486/972] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:30.292137 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45175935-312d-4e35-9225-27cdf7b4d9e2 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:30.343863 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc227e0-3d9a-4ec6-9380-ef33b9f3a1bd None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:30.390192 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2ef9b-09b5-4bfd-a72e-c4b9e83247c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:30.391772 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2ef9b-09b5-4bfd-a72e-c4b9e83247c2 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:30.392296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2ef9b-09b5-4bfd-a72e-c4b9e83247c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:30.393669 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2ef9b-09b5-4bfd-a72e-c4b9e83247c2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:30.399633 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45175935-312d-4e35-9225-27cdf7b4d9e2 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:30.404960 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2ef9b-09b5-4bfd-a72e-c4b9e83247c2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:30.406550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2ef9b-09b5-4bfd-a72e-c4b9e83247c2 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:30.421405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-c3c2ef9b-09b5-4bfd-a72e-c4b9e83247c2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 09:48:30.421405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:30.421405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:30.421405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:30.421405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:30.421405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:30.421405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:30.421405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:30.421405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:30.421405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:30.421405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:30.421405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:30.421405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:48:30.421405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:48:30.421405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:48:30.421405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:30.422733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:30.423934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:30.423934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:30.423934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:48:30.423934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:48:30.423934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:48:30.423934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:48:30.423934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:48:30.423934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:48:30.423934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 09:48:30.423934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:30.431026 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 487/973] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:48:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:30.432285 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2ef9b-09b5-4bfd-a72e-c4b9e83247c2 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:30.444289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235565a9-ac46-43a6-b2ef-77b8388c0865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:30.445743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235565a9-ac46-43a6-b2ef-77b8388c0865 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:30.446497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235565a9-ac46-43a6-b2ef-77b8388c0865 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:30.446920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235565a9-ac46-43a6-b2ef-77b8388c0865 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:30.456469 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235565a9-ac46-43a6-b2ef-77b8388c0865 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:30.458649 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235565a9-ac46-43a6-b2ef-77b8388c0865 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:30.479379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-235565a9-ac46-43a6-b2ef-77b8388c0865 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 09:48:30.479379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:30.479379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:30.479379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:30.479379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:30.479379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:30.479379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:30.479379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:30.479379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:30.479379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:30.479379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:30.479379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:30.479379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:48:30.479379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:48:30.479379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:48:30.479379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:30.480586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:30.481825 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:30.481825 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:30.481825 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:48:30.481825 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:48:30.481825 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:48:30.481825 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:48:30.481825 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:48:30.481825 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:48:30.481825 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 09:48:30.481825 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:30.484692 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 487/974] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 3 09:48:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:30.490760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235565a9-ac46-43a6-b2ef-77b8388c0865 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:30.547724 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2ef9b-09b5-4bfd-a72e-c4b9e83247c2 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:30.584646 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a0208-753b-4b52-8f4b-9928978b535f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:30.585582 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a0208-753b-4b52-8f4b-9928978b535f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:30.585985 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a0208-753b-4b52-8f4b-9928978b535f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:30.586350 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a0208-753b-4b52-8f4b-9928978b535f None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:30.587271 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a0208-753b-4b52-8f4b-9928978b535f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:30.587671 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a0208-753b-4b52-8f4b-9928978b535f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:30.589185 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a0208-753b-4b52-8f4b-9928978b535f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:30.593889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235565a9-ac46-43a6-b2ef-77b8388c0865 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:30.630682 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0e3bd-351a-4d3f-a6e2-8b0a4b6500e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:30.631596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0e3bd-351a-4d3f-a6e2-8b0a4b6500e4 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:30.631997 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0e3bd-351a-4d3f-a6e2-8b0a4b6500e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:30.632477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0e3bd-351a-4d3f-a6e2-8b0a4b6500e4 None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:30.633456 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0e3bd-351a-4d3f-a6e2-8b0a4b6500e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:30.634413 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 488/975] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 3 09:48:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:30.634579 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0e3bd-351a-4d3f-a6e2-8b0a4b6500e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:30.636173 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0e3bd-351a-4d3f-a6e2-8b0a4b6500e4 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:30.656954 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 488/976] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 3 09:48:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:30.663173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a0208-753b-4b52-8f4b-9928978b535f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:30.769738 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a0208-753b-4b52-8f4b-9928978b535f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:30.805985 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fe5ab-00ad-402e-97c7-d43b0254ea70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:30.806896 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fe5ab-00ad-402e-97c7-d43b0254ea70 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:30.807327 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fe5ab-00ad-402e-97c7-d43b0254ea70 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:30.807752 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fe5ab-00ad-402e-97c7-d43b0254ea70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:30.875803 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fe5ab-00ad-402e-97c7-d43b0254ea70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:30.877488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fe5ab-00ad-402e-97c7-d43b0254ea70 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:30.972506 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 489/977] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:48:30 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:48:30.978811 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0e3bd-351a-4d3f-a6e2-8b0a4b6500e4 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:31.074966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0e3bd-351a-4d3f-a6e2-8b0a4b6500e4 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:31.108874 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68509b10-d37f-4600-988c-0b240e2451aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:31.109632 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68509b10-d37f-4600-988c-0b240e2451aa None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:31.109959 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68509b10-d37f-4600-988c-0b240e2451aa None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:31.110224 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68509b10-d37f-4600-988c-0b240e2451aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:31.120184 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68509b10-d37f-4600-988c-0b240e2451aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:31.121608 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68509b10-d37f-4600-988c-0b240e2451aa None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:31.138911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-68509b10-d37f-4600-988c-0b240e2451aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:31.138911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:31.138911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:31.138911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:31.138911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:31.138911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:31.138911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:31.138911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:31.138911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:31.138911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:31.138911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:31.138911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:31.138911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:31.138911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:31.138911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:31.139891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:31.139891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:31.139891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:31.139891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:31.139891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:31.139891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:31.139891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:31.139891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:31.139891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:31.139891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:31.139891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:31.139891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:31.139891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:31.139891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:31.139891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:31.139891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:31.139891 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:31.140810 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:31.140810 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:31.140810 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:31.140810 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:31.140810 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 489/978] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:31.146889 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fe5ab-00ad-402e-97c7-d43b0254ea70 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:31.241338 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fe5ab-00ad-402e-97c7-d43b0254ea70 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:31.278092 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495131fc-baf1-4f37-85b2-0373e0a926d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:31.278746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495131fc-baf1-4f37-85b2-0373e0a926d3 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:31.279017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495131fc-baf1-4f37-85b2-0373e0a926d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:31.279282 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495131fc-baf1-4f37-85b2-0373e0a926d3 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:31.279990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495131fc-baf1-4f37-85b2-0373e0a926d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:31.280288 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495131fc-baf1-4f37-85b2-0373e0a926d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:31.281630 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495131fc-baf1-4f37-85b2-0373e0a926d3 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:31.295943 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 490/979] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:31.301376 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68509b10-d37f-4600-988c-0b240e2451aa None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:31.400365 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68509b10-d37f-4600-988c-0b240e2451aa None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:31.438556 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d937d4f-e483-47a8-8c9e-f679e01574a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:31.439362 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d937d4f-e483-47a8-8c9e-f679e01574a9 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:31.439638 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d937d4f-e483-47a8-8c9e-f679e01574a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:31.439907 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d937d4f-e483-47a8-8c9e-f679e01574a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:31.447199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d937d4f-e483-47a8-8c9e-f679e01574a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:31.448644 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d937d4f-e483-47a8-8c9e-f679e01574a9 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:31.462262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-1d937d4f-e483-47a8-8c9e-f679e01574a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:31.462262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:31.462262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:31.462262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:31.462262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:31.462262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:31.462262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:31.462262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:31.462262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:31.462262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:31.462262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:31.462262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:31.462262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:48:31.462262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:48:31.462262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:48:31.463193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:48:31.463193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:31.463193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:31.463193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:31.463193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:31.463193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:31.463193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:31.463193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:31.463193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:31.463193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:31.463193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:31.463193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:31.463193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:31.463193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:31.463193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:31.463193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:31.463193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:31.464099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:48:31.464099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:48:31.464099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:48:31.464099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:48:31.464099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:48:31.464099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:48:31.464099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:31.464099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:31.464099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 490/980] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:31.470595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495131fc-baf1-4f37-85b2-0373e0a926d3 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:31.570556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495131fc-baf1-4f37-85b2-0373e0a926d3 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:31.603826 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae262bc0-99de-47c6-a8f6-5ea2f4997722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:31.604490 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae262bc0-99de-47c6-a8f6-5ea2f4997722 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:31.604742 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae262bc0-99de-47c6-a8f6-5ea2f4997722 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:31.605023 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae262bc0-99de-47c6-a8f6-5ea2f4997722 None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:31.605816 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae262bc0-99de-47c6-a8f6-5ea2f4997722 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:31.606143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae262bc0-99de-47c6-a8f6-5ea2f4997722 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:31.607552 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae262bc0-99de-47c6-a8f6-5ea2f4997722 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:31.612345 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedffd2-fc54-40a7-95d5-c0bb93ec9af6 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:31.612627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedffd2-fc54-40a7-95d5-c0bb93ec9af6 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:31.612902 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedffd2-fc54-40a7-95d5-c0bb93ec9af6 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:31.614427 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 491/981] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:48:31.619404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c6c9a-b940-44fc-909b-4bb620dfb0dc None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:31.619686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c6c9a-b940-44fc-909b-4bb620dfb0dc None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:31.624796 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c6c9a-b940-44fc-909b-4bb620dfb0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:31.624910 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 491/982] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:48:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:31.626056 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae262bc0-99de-47c6-a8f6-5ea2f4997722 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:31.641111 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-cc2c6c9a-b940-44fc-909b-4bb620dfb0dc None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:31.642445 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-cc2c6c9a-b940-44fc-909b-4bb620dfb0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:31.712596 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 492/983] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:48:31.725030 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae262bc0-99de-47c6-a8f6-5ea2f4997722 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:31.735011 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c6c9a-b940-44fc-909b-4bb620dfb0dc None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:31.759497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0baae-59bd-4667-8da3-25e8c56039e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:31.760151 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0baae-59bd-4667-8da3-25e8c56039e7 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:31.760425 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0baae-59bd-4667-8da3-25e8c56039e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:31.760697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0baae-59bd-4667-8da3-25e8c56039e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:31.761553 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0baae-59bd-4667-8da3-25e8c56039e7 None admin] RBAC: Adding query filter params (role.id=97c22875d1454453affa45b653c6eeed, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=62b336ab0cfd4bfd9ec498dcd940332f) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:31.761855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0baae-59bd-4667-8da3-25e8c56039e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:31.763287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0baae-59bd-4667-8da3-25e8c56039e7 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:31.769136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 492/984] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:48:31 2022] GET /identity/v3/role_assignments?user.id=62b336ab0cfd4bfd9ec498dcd940332f&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=97c22875d1454453affa45b653c6eeed => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:31.837730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485c7f6-fc5c-4510-8978-6f23075a3c1e None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:31.838293 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485c7f6-fc5c-4510-8978-6f23075a3c1e None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:31.838567 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485c7f6-fc5c-4510-8978-6f23075a3c1e None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:31.839997 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 493/985] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:48:31.846543 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02019747-1142-410e-8ead-70e4b7996984 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:31.846849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02019747-1142-410e-8ead-70e4b7996984 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:31.847094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02019747-1142-410e-8ead-70e4b7996984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:31.847936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c6c9a-b940-44fc-909b-4bb620dfb0dc None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:31.864377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-02019747-1142-410e-8ead-70e4b7996984 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:31.865955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-02019747-1142-410e-8ead-70e4b7996984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:31.885250 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f26e5-7840-4a04-8770-b50f4fb8341a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:31.886093 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f26e5-7840-4a04-8770-b50f4fb8341a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:31.886371 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f26e5-7840-4a04-8770-b50f4fb8341a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:31.886640 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f26e5-7840-4a04-8770-b50f4fb8341a None admin] PATH_INFO: `/v3/services/compute` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:31.887299 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f26e5-7840-4a04-8770-b50f4fb8341a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:31.888681 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f26e5-7840-4a04-8770-b50f4fb8341a None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:31.900900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-884f26e5-7840-4a04-8770-b50f4fb8341a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 09:48:31.900900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:31.900900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:31.900900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:31.900900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:31.900900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:31.900900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:31.900900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:31.900900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 09:48:31.900900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:31.900900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:31.900900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:31.900900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:31.900900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:31.900900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:31.900900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:31.900900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:31.902125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:31.902125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:31.902125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:31.902125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:31.902125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:31.902125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:31.902125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:31.902125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:31.902125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:31.902125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:31.902125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:31.902125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:31.902125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:31.902125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:31.902125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:31.902125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:31.908618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:31.908618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:31.908618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:31.908618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:31.908618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:31.908618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:31.908618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:31.908618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:31.908618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:31.908618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:31.908618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:31.908618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:31.908618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 09:48:31.908618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:31.908618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 493/986] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:31.909422 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f26e5-7840-4a04-8770-b50f4fb8341a None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:31.939886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 494/987] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:48:31.962559 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02019747-1142-410e-8ead-70e4b7996984 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:32.013265 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f26e5-7840-4a04-8770-b50f4fb8341a None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:32.048672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86847e80-9eab-43c4-a36a-38127e760d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:32.049335 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86847e80-9eab-43c4-a36a-38127e760d48 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:32.049611 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86847e80-9eab-43c4-a36a-38127e760d48 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:32.049911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86847e80-9eab-43c4-a36a-38127e760d48 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:32.050608 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86847e80-9eab-43c4-a36a-38127e760d48 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:32.050909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86847e80-9eab-43c4-a36a-38127e760d48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:32.052265 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86847e80-9eab-43c4-a36a-38127e760d48 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:32.057762 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 494/988] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 3 09:48:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:32.062978 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86847e80-9eab-43c4-a36a-38127e760d48 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:32.063731 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02019747-1142-410e-8ead-70e4b7996984 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:32.097577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66265abd-05aa-45f7-9f2f-5fea270f38ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:32.098398 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66265abd-05aa-45f7-9f2f-5fea270f38ed None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:32.098673 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66265abd-05aa-45f7-9f2f-5fea270f38ed None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:32.098937 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66265abd-05aa-45f7-9f2f-5fea270f38ed None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:32.099588 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66265abd-05aa-45f7-9f2f-5fea270f38ed None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:32.101116 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66265abd-05aa-45f7-9f2f-5fea270f38ed None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:32.113407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-66265abd-05aa-45f7-9f2f-5fea270f38ed None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 09:48:32.113407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:32.113407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:32.113407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:32.113407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:32.113407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:32.113407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:32.113407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:32.113407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 09:48:32.113407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:32.113407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:32.113407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:32.113407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:32.113407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:32.113407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:32.113407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:32.113407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:32.114504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:32.114504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:32.114504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:32.114504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:32.114504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:32.114504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:32.114504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:32.114504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:32.114504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:32.114504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:32.114504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:32.114504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:32.114504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:32.114504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:32.114504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:32.114504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:32.115346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:32.115346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:32.115346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:32.115346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:32.115346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:32.115346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:32.115346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:32.115346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:32.115346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:32.115346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:32.115346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:32.115346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:32.115346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 09:48:32.115346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:32.118155 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 495/989] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 3 09:48:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:32.120738 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66265abd-05aa-45f7-9f2f-5fea270f38ed None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:32.164407 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86847e80-9eab-43c4-a36a-38127e760d48 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:32.199001 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62e0d0-4752-4bf2-af1e-1b7bfc29ad95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:32.199672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62e0d0-4752-4bf2-af1e-1b7bfc29ad95 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:32.199953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62e0d0-4752-4bf2-af1e-1b7bfc29ad95 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:32.200224 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62e0d0-4752-4bf2-af1e-1b7bfc29ad95 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:32.200958 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62e0d0-4752-4bf2-af1e-1b7bfc29ad95 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:32.201271 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62e0d0-4752-4bf2-af1e-1b7bfc29ad95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:32.202688 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62e0d0-4752-4bf2-af1e-1b7bfc29ad95 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:32.207443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 495/990] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 3 09:48:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:32.213124 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62e0d0-4752-4bf2-af1e-1b7bfc29ad95 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:32.224311 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66265abd-05aa-45f7-9f2f-5fea270f38ed None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:32.261751 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ec969-e093-4e77-bb37-d9648df8cde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:32.262907 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ec969-e093-4e77-bb37-d9648df8cde0 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:32.263383 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ec969-e093-4e77-bb37-d9648df8cde0 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:32.263797 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ec969-e093-4e77-bb37-d9648df8cde0 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:32.265039 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ec969-e093-4e77-bb37-d9648df8cde0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:32.265503 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ec969-e093-4e77-bb37-d9648df8cde0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:32.267440 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ec969-e093-4e77-bb37-d9648df8cde0 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:32.277032 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 496/991] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 3 09:48:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:32.279445 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ec969-e093-4e77-bb37-d9648df8cde0 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:32.319163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62e0d0-4752-4bf2-af1e-1b7bfc29ad95 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:32.350114 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1349f-36cc-4549-b5a5-144ae9372732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:32.350772 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1349f-36cc-4549-b5a5-144ae9372732 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:32.351236 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1349f-36cc-4549-b5a5-144ae9372732 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:32.351508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1349f-36cc-4549-b5a5-144ae9372732 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:32.352289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1349f-36cc-4549-b5a5-144ae9372732 None admin] RBAC: Adding query filter params (interface=public, service_id=89e4c8f4ba304eb8a6c53437fd404405, region_id=RegionOne) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:32.352593 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1349f-36cc-4549-b5a5-144ae9372732 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:32.353966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1349f-36cc-4549-b5a5-144ae9372732 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:32.359397 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 496/992] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 3 09:48:32 2022] GET /identity/v3/endpoints?service_id=89e4c8f4ba304eb8a6c53437fd404405&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:32.364522 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1349f-36cc-4549-b5a5-144ae9372732 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:32.379923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ec969-e093-4e77-bb37-d9648df8cde0 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:32.413213 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac979a-d132-41e4-8402-51451eb4380a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:32.414009 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac979a-d132-41e4-8402-51451eb4380a None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:32.414291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac979a-d132-41e4-8402-51451eb4380a None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:32.414570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac979a-d132-41e4-8402-51451eb4380a None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:32.415266 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac979a-d132-41e4-8402-51451eb4380a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:32.415567 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac979a-d132-41e4-8402-51451eb4380a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:32.416923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac979a-d132-41e4-8402-51451eb4380a None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:32.421601 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 497/993] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 3 09:48:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:32.427329 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac979a-d132-41e4-8402-51451eb4380a None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:32.474289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1349f-36cc-4549-b5a5-144ae9372732 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:32.507857 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce28f1d-6ea8-4eb8-b6f7-73ff58bc2605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:32.508973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28f1d-6ea8-4eb8-b6f7-73ff58bc2605 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:32.509254 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28f1d-6ea8-4eb8-b6f7-73ff58bc2605 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:32.509525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28f1d-6ea8-4eb8-b6f7-73ff58bc2605 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:32.510239 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce28f1d-6ea8-4eb8-b6f7-73ff58bc2605 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:32.511602 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce28f1d-6ea8-4eb8-b6f7-73ff58bc2605 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:32.517822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 497/994] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 3 09:48:32 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 09:48:32.524101 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac979a-d132-41e4-8402-51451eb4380a None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:32.560580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376549d8-e92f-4cfa-953c-6a9ab37ea87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:32.561584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376549d8-e92f-4cfa-953c-6a9ab37ea87f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:32.562078 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376549d8-e92f-4cfa-953c-6a9ab37ea87f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:32.562491 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376549d8-e92f-4cfa-953c-6a9ab37ea87f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:32.563455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376549d8-e92f-4cfa-953c-6a9ab37ea87f None admin] RBAC: Adding query filter params (interface=admin, service_id=bb5376744d3940ce9ac9de46148324e3, region_id=RegionOne) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:32.563917 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376549d8-e92f-4cfa-953c-6a9ab37ea87f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:32.565517 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376549d8-e92f-4cfa-953c-6a9ab37ea87f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:32.572116 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 498/995] 10.222.0.55 () {56 vars in 1249 bytes} [Tue May 3 09:48:32 2022] GET /identity/v3/endpoints?service_id=bb5376744d3940ce9ac9de46148324e3&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:32.578497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce28f1d-6ea8-4eb8-b6f7-73ff58bc2605 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:32.685450 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce28f1d-6ea8-4eb8-b6f7-73ff58bc2605 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:32.719550 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37840c7-90d2-4362-bc42-32e2df59bb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:32.720196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37840c7-90d2-4362-bc42-32e2df59bb11 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:32.720473 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37840c7-90d2-4362-bc42-32e2df59bb11 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:32.720740 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37840c7-90d2-4362-bc42-32e2df59bb11 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:32.721411 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37840c7-90d2-4362-bc42-32e2df59bb11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:32.722814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37840c7-90d2-4362-bc42-32e2df59bb11 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:32.733920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 498/996] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 3 09:48:32 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:48:34.024723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee8863-47c0-41ae-8b64-0caba7faa2f0 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:34.025262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee8863-47c0-41ae-8b64-0caba7faa2f0 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:34.025262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee8863-47c0-41ae-8b64-0caba7faa2f0 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:34.026646 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 499/997] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:34.032091 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e94989-f15b-493c-b853-ecf5a2ff1eef None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:34.032530 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e94989-f15b-493c-b853-ecf5a2ff1eef None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:34.032671 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e94989-f15b-493c-b853-ecf5a2ff1eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:34.050661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-03e94989-f15b-493c-b853-ecf5a2ff1eef None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:34.051824 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-03e94989-f15b-493c-b853-ecf5a2ff1eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:34.120011 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 499/998] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:34.142035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee8863-47c0-41ae-8b64-0caba7faa2f0 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:34.241679 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee8863-47c0-41ae-8b64-0caba7faa2f0 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:34.281045 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5983e-3286-48cf-be4f-06dd0ff94b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:34.281827 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5983e-3286-48cf-be4f-06dd0ff94b83 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:34.282138 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5983e-3286-48cf-be4f-06dd0ff94b83 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:34.282392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5983e-3286-48cf-be4f-06dd0ff94b83 None admin] PATH_INFO: `/v3/services/image` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:34.283063 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5983e-3286-48cf-be4f-06dd0ff94b83 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:34.286813 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5983e-3286-48cf-be4f-06dd0ff94b83 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:34.299595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-e7f5983e-3286-48cf-be4f-06dd0ff94b83 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 09:48:34.299595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:34.299595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:34.299595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:34.299595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:34.299595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:34.299595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:34.299595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:34.299595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 09:48:34.299595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:34.299595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:34.299595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:34.299595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:34.299595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:34.299595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:34.299595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:34.299595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:34.300652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:34.300652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:34.300652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:34.300652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:34.300652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:34.300652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:34.300652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:34.300652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:34.300652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:34.300652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:34.300652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:34.300652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:34.300652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:34.300652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:34.300652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:34.300652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:34.302214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:34.302214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:34.302214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:34.302214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:34.302214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:34.302214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:34.302214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:34.302214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:34.302214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:34.302214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:34.302214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:34.302214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:34.302214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 09:48:34.302214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:34.302214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 500/999] 10.222.0.55 () {56 vars in 1105 bytes} [Tue May 3 09:48:34 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:34.308961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e94989-f15b-493c-b853-ecf5a2ff1eef None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:34.398906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e94989-f15b-493c-b853-ecf5a2ff1eef None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:34.431083 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c7a8e-3e8c-4196-8f5b-009f0136cce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:34.431742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c7a8e-3e8c-4196-8f5b-009f0136cce2 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:34.432020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c7a8e-3e8c-4196-8f5b-009f0136cce2 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:34.432282 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c7a8e-3e8c-4196-8f5b-009f0136cce2 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:34.432977 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c7a8e-3e8c-4196-8f5b-009f0136cce2 None admin] RBAC: Adding query filter params (name=image) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:34.433272 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c7a8e-3e8c-4196-8f5b-009f0136cce2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:34.434642 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c7a8e-3e8c-4196-8f5b-009f0136cce2 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:34.439487 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 500/1000] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:34.444965 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5983e-3286-48cf-be4f-06dd0ff94b83 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:34.538117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5983e-3286-48cf-be4f-06dd0ff94b83 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:34.574286 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe5ed5-104c-43d9-a605-84a0a3f32cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:34.574961 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe5ed5-104c-43d9-a605-84a0a3f32cda None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:34.575213 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe5ed5-104c-43d9-a605-84a0a3f32cda None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:34.575504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe5ed5-104c-43d9-a605-84a0a3f32cda None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:34.576220 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe5ed5-104c-43d9-a605-84a0a3f32cda None admin] RBAC: Adding query filter params (type=image) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:34.576520 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe5ed5-104c-43d9-a605-84a0a3f32cda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:34.577927 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe5ed5-104c-43d9-a605-84a0a3f32cda None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:34.583351 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 501/1001] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:34.751369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2ae2c-b945-452c-b357-d100e175f9fb None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:34.751700 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2ae2c-b945-452c-b357-d100e175f9fb None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:34.751916 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2ae2c-b945-452c-b357-d100e175f9fb None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:34.753837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 501/1002] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:34.759657 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2589b2-f9de-4169-909d-27e699c707a7 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:34.759974 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2589b2-f9de-4169-909d-27e699c707a7 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:34.760249 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2589b2-f9de-4169-909d-27e699c707a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:34.778957 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-cc2589b2-f9de-4169-909d-27e699c707a7 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:34.780264 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-cc2589b2-f9de-4169-909d-27e699c707a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:34.849040 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 502/1003] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:34.871386 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2ae2c-b945-452c-b357-d100e175f9fb None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:34.971555 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2ae2c-b945-452c-b357-d100e175f9fb None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:34.979197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677f71a-ddda-4cc4-bcbb-480a4df7e48b None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:34.979488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677f71a-ddda-4cc4-bcbb-480a4df7e48b None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:34.979764 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677f71a-ddda-4cc4-bcbb-480a4df7e48b None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:34.981278 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 503/1004] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:48:34.986106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bed2a-485d-4d0f-abed-aa87c5513140 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:34.986382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bed2a-485d-4d0f-abed-aa87c5513140 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:34.986650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bed2a-485d-4d0f-abed-aa87c5513140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:35.003392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-8b9bed2a-485d-4d0f-abed-aa87c5513140 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:35.004540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-8b9bed2a-485d-4d0f-abed-aa87c5513140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:35.006406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5f09d-b6e0-4b97-9c07-bd631789e7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:35.007253 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5f09d-b6e0-4b97-9c07-bd631789e7aa None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:35.007609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5f09d-b6e0-4b97-9c07-bd631789e7aa None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:35.008166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5f09d-b6e0-4b97-9c07-bd631789e7aa None admin] PATH_INFO: `/v3/services/compute` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:35.009209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5f09d-b6e0-4b97-9c07-bd631789e7aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:35.010611 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5f09d-b6e0-4b97-9c07-bd631789e7aa None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:35.022402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-f0d5f09d-b6e0-4b97-9c07-bd631789e7aa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 09:48:35.022402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:35.022402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:35.022402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:35.022402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:35.022402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:35.022402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:35.022402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:35.022402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 09:48:35.022402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:35.022402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:35.022402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:35.022402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:35.022402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:35.022402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:35.022402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:35.022402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:35.023684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:35.023684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:35.023684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:35.023684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:35.023684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:35.023684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:35.023684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:35.023684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:35.023684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:35.023684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:35.023684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:35.023684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:35.023684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:35.023684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:35.023684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:35.023684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:35.024820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:35.024820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:35.024820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:35.024820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:35.024820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:35.024820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:35.024820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:35.024820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:35.024820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:35.024820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:35.024820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:35.024820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:35.024820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 09:48:35.024820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:35.024820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 502/1005] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:35.030100 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5f09d-b6e0-4b97-9c07-bd631789e7aa None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:35.074078 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 504/1006] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:48:35.096659 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bed2a-485d-4d0f-abed-aa87c5513140 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:35.126315 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5f09d-b6e0-4b97-9c07-bd631789e7aa None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:35.159780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16d73a-342c-430d-b488-bea1d99ce7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:35.160440 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16d73a-342c-430d-b488-bea1d99ce7a3 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:35.160717 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16d73a-342c-430d-b488-bea1d99ce7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:35.160982 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16d73a-342c-430d-b488-bea1d99ce7a3 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:35.161686 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16d73a-342c-430d-b488-bea1d99ce7a3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:35.162036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16d73a-342c-430d-b488-bea1d99ce7a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:35.163476 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16d73a-342c-430d-b488-bea1d99ce7a3 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:35.168248 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 503/1007] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 3 09:48:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:35.173785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16d73a-342c-430d-b488-bea1d99ce7a3 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:35.197941 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bed2a-485d-4d0f-abed-aa87c5513140 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:35.230455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b11cb-8880-4479-b13b-e64708658c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:35.231261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b11cb-8880-4479-b13b-e64708658c2a None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:35.231540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b11cb-8880-4479-b13b-e64708658c2a None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:35.231814 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b11cb-8880-4479-b13b-e64708658c2a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:35.232466 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b11cb-8880-4479-b13b-e64708658c2a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:35.233837 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b11cb-8880-4479-b13b-e64708658c2a None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:35.245629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-7d3b11cb-8880-4479-b13b-e64708658c2a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 09:48:35.245629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:35.245629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:35.245629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:35.245629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:35.245629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:35.245629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:35.245629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:35.245629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 09:48:35.245629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:35.245629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:35.245629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:35.245629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:35.245629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:35.245629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:35.245629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:35.245629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:35.246858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:35.246858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:35.246858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:35.246858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:35.246858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:35.246858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:35.246858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:35.246858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:35.246858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:35.246858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:35.246858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:35.246858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:35.246858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:35.246858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:35.246858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:35.246858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:35.247922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:35.247922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:35.247922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:35.247922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:35.247922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:35.247922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:35.247922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:35.247922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:35.247922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:35.247922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:35.247922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:35.247922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:35.247922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 09:48:35.247922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:35.247922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 505/1008] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 3 09:48:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:35.255797 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b11cb-8880-4479-b13b-e64708658c2a None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:35.275232 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16d73a-342c-430d-b488-bea1d99ce7a3 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:35.309088 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b05a9-cecf-4729-9052-4bcf0cb39138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:35.309761 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b05a9-cecf-4729-9052-4bcf0cb39138 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:35.310071 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b05a9-cecf-4729-9052-4bcf0cb39138 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:35.310342 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b05a9-cecf-4729-9052-4bcf0cb39138 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:35.311052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b05a9-cecf-4729-9052-4bcf0cb39138 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:35.311357 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b05a9-cecf-4729-9052-4bcf0cb39138 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:35.312720 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b05a9-cecf-4729-9052-4bcf0cb39138 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:35.322788 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 504/1009] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 3 09:48:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:35.323453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b05a9-cecf-4729-9052-4bcf0cb39138 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:35.355431 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b11cb-8880-4479-b13b-e64708658c2a None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:35.389103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e253dfb-61ba-44ec-94c8-72afb0cea8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:35.389695 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e253dfb-61ba-44ec-94c8-72afb0cea8ea None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:35.389998 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e253dfb-61ba-44ec-94c8-72afb0cea8ea None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:35.390271 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e253dfb-61ba-44ec-94c8-72afb0cea8ea None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:35.390977 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e253dfb-61ba-44ec-94c8-72afb0cea8ea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:35.391281 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e253dfb-61ba-44ec-94c8-72afb0cea8ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:35.392697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e253dfb-61ba-44ec-94c8-72afb0cea8ea None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:35.401192 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 506/1010] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 3 09:48:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:35.406979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e253dfb-61ba-44ec-94c8-72afb0cea8ea None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:35.424919 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b05a9-cecf-4729-9052-4bcf0cb39138 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:35.458085 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e218c4-d1c1-4407-90ed-1f55b274c8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:35.458769 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e218c4-d1c1-4407-90ed-1f55b274c8be None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:35.459043 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e218c4-d1c1-4407-90ed-1f55b274c8be None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:35.459310 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e218c4-d1c1-4407-90ed-1f55b274c8be None admin] PATH_INFO: `/v3/endpoints` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:35.460041 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e218c4-d1c1-4407-90ed-1f55b274c8be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:35.461384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e218c4-d1c1-4407-90ed-1f55b274c8be None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:35.486261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 505/1011] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 3 09:48:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:48:35.506277 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e253dfb-61ba-44ec-94c8-72afb0cea8ea None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:35.550107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134378d-ca9d-4e0a-97e6-7415da88f5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:35.550774 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134378d-ca9d-4e0a-97e6-7415da88f5a7 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:35.551063 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134378d-ca9d-4e0a-97e6-7415da88f5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:35.551315 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134378d-ca9d-4e0a-97e6-7415da88f5a7 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:35.552090 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134378d-ca9d-4e0a-97e6-7415da88f5a7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:35.552391 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134378d-ca9d-4e0a-97e6-7415da88f5a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:35.553785 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134378d-ca9d-4e0a-97e6-7415da88f5a7 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:35.559522 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 507/1012] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 3 09:48:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:35.565352 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e218c4-d1c1-4407-90ed-1f55b274c8be None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:35.669639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e218c4-d1c1-4407-90ed-1f55b274c8be None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:35.702544 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bd40d-4a5e-4ed0-99ee-298f7af38944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:35.703204 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bd40d-4a5e-4ed0-99ee-298f7af38944 None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:35.703476 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bd40d-4a5e-4ed0-99ee-298f7af38944 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:35.703746 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bd40d-4a5e-4ed0-99ee-298f7af38944 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:35.704492 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9bd40d-4a5e-4ed0-99ee-298f7af38944 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:35.705932 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9bd40d-4a5e-4ed0-99ee-298f7af38944 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:35.721420 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 506/1013] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 3 09:48:35 2022] POST /identity/v3/endpoints => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:48:36.866498 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4d8e0-3496-47d2-887b-cba805b41298 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:36.867047 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4d8e0-3496-47d2-887b-cba805b41298 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:36.867356 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4d8e0-3496-47d2-887b-cba805b41298 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:36.868972 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 508/1014] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:36.874205 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54494a4f-ee83-4b9c-a9bd-0bf395eaac8f None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:36.874629 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54494a4f-ee83-4b9c-a9bd-0bf395eaac8f None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:36.874818 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54494a4f-ee83-4b9c-a9bd-0bf395eaac8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:36.892116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-54494a4f-ee83-4b9c-a9bd-0bf395eaac8f None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:36.893302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-54494a4f-ee83-4b9c-a9bd-0bf395eaac8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:36.966340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 507/1015] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:36 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:36.988569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4d8e0-3496-47d2-887b-cba805b41298 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:37.091011 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4d8e0-3496-47d2-887b-cba805b41298 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:37.125349 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20b876-e1df-4069-8b3e-a4ac269bd904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:37.125962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20b876-e1df-4069-8b3e-a4ac269bd904 None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:37.126244 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20b876-e1df-4069-8b3e-a4ac269bd904 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:37.126514 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20b876-e1df-4069-8b3e-a4ac269bd904 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:37.127271 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20b876-e1df-4069-8b3e-a4ac269bd904 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:37.128642 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20b876-e1df-4069-8b3e-a4ac269bd904 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:37.144554 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 509/1016] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 3 09:48:36 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:48:37.828287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02ba02-8d31-4865-97b1-0c39130b7c43 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:37.828719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02ba02-8d31-4865-97b1-0c39130b7c43 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:37.828823 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02ba02-8d31-4865-97b1-0c39130b7c43 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:37.830403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 508/1017] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:37.835602 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b9c92-81ce-4f5e-b0f0-4c53b9937f46 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:37.835931 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b9c92-81ce-4f5e-b0f0-4c53b9937f46 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:37.836210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b9c92-81ce-4f5e-b0f0-4c53b9937f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:37.853967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-046b9c92-81ce-4f5e-b0f0-4c53b9937f46 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:37.855139 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-046b9c92-81ce-4f5e-b0f0-4c53b9937f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:37.927834 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 510/1018] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:37.951193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02ba02-8d31-4865-97b1-0c39130b7c43 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:37.971095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff836590-d7b8-4d66-ac17-ac85b26511cb None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:37.971443 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff836590-d7b8-4d66-ac17-ac85b26511cb None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:37.971608 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff836590-d7b8-4d66-ac17-ac85b26511cb None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:37.973255 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 511/1019] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:48:37.978154 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a7e6e-cea2-4413-b536-fd6dc2ed1ccf None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:37.978439 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a7e6e-cea2-4413-b536-fd6dc2ed1ccf None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:37.978705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a7e6e-cea2-4413-b536-fd6dc2ed1ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:37.995044 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-138a7e6e-cea2-4413-b536-fd6dc2ed1ccf None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:37.996212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-138a7e6e-cea2-4413-b536-fd6dc2ed1ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:38.052301 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02ba02-8d31-4865-97b1-0c39130b7c43 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:38.061482 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 512/1020] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:48:38.084722 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a7e6e-cea2-4413-b536-fd6dc2ed1ccf None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:38.087235 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dff94e-1ec5-4f0e-8dbd-9ff720638027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:38.087235 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dff94e-1ec5-4f0e-8dbd-9ff720638027 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:38.088152 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dff94e-1ec5-4f0e-8dbd-9ff720638027 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:38.088425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dff94e-1ec5-4f0e-8dbd-9ff720638027 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:38.098442 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dff94e-1ec5-4f0e-8dbd-9ff720638027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:48:38.106775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-53dff94e-1ec5-4f0e-8dbd-9ff720638027 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 09:48:38.106775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:38.106775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:38.106775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:38.106775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:38.106775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:38.106775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:38.106775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:38.106775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:38.106775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:38.106775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:38.106775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:38.106775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:48:38.106775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:48:38.106775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:48:38.106775 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:48:38.107745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:48:38.107745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:48:38.107745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:48:38.107745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:48:38.107745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:38.107745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:38.107745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:38.107745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:38.107745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:38.107745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:38.107745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:38.107745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:38.107745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:38.107745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:38.107745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:38.107745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:38.114284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:38.114284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:38.114284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:38.114284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:38.114284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:48:38.114284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:48:38.114284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:48:38.114284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:48:38.114284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:48:38.114284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:48:38.114284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 09:48:38.114284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:38.114284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 509/1021] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 3 09:48:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:38.114284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dff94e-1ec5-4f0e-8dbd-9ff720638027 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:38.181511 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a7e6e-cea2-4413-b536-fd6dc2ed1ccf None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:38.212856 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dff94e-1ec5-4f0e-8dbd-9ff720638027 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:38.214694 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c3b70-00b4-47e5-9eb2-c4b6a703770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:38.215569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c3b70-00b4-47e5-9eb2-c4b6a703770a None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:38.215846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c3b70-00b4-47e5-9eb2-c4b6a703770a None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:38.216118 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c3b70-00b4-47e5-9eb2-c4b6a703770a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:38.217323 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c3b70-00b4-47e5-9eb2-c4b6a703770a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:38.218801 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c3b70-00b4-47e5-9eb2-c4b6a703770a None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:38.220431 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 513/1022] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:38.226404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c3b70-00b4-47e5-9eb2-c4b6a703770a None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:38.247245 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53b6b0-6fbe-40a5-98bd-a36af942527e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:38.247980 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53b6b0-6fbe-40a5-98bd-a36af942527e None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:38.248264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53b6b0-6fbe-40a5-98bd-a36af942527e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:38.248535 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53b6b0-6fbe-40a5-98bd-a36af942527e None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:38.249276 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53b6b0-6fbe-40a5-98bd-a36af942527e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:38.249583 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53b6b0-6fbe-40a5-98bd-a36af942527e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:38.251016 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53b6b0-6fbe-40a5-98bd-a36af942527e None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:38.261846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 510/1023] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 3 09:48:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:38.267361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53b6b0-6fbe-40a5-98bd-a36af942527e None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:38.337537 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c3b70-00b4-47e5-9eb2-c4b6a703770a None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:38.373076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1239a-e2e9-4c67-99b2-ecd2ca23ff2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:38.373750 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1239a-e2e9-4c67-99b2-ecd2ca23ff2b None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:38.374062 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1239a-e2e9-4c67-99b2-ecd2ca23ff2b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:38.374337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1239a-e2e9-4c67-99b2-ecd2ca23ff2b None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:38.375043 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1239a-e2e9-4c67-99b2-ecd2ca23ff2b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:38.376218 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53b6b0-6fbe-40a5-98bd-a36af942527e None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:38.376469 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1239a-e2e9-4c67-99b2-ecd2ca23ff2b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:38.403569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 514/1024] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 3 09:48:38 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:48:38.416118 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad46fc-8deb-410c-a9dd-01a89885528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:38.416945 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad46fc-8deb-410c-a9dd-01a89885528d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:38.417227 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad46fc-8deb-410c-a9dd-01a89885528d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:38.417497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad46fc-8deb-410c-a9dd-01a89885528d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:38.429902 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad46fc-8deb-410c-a9dd-01a89885528d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:38.431402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad46fc-8deb-410c-a9dd-01a89885528d None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:38.451025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-7dad46fc-8deb-410c-a9dd-01a89885528d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:38.451025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:38.451025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:38.451025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:38.451025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:38.451025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:38.451025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:38.451025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:38.451025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:38.451025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:38.451025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:38.451025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:38.451025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:38.451025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:38.451025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:38.452044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:38.452044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:38.452044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:38.452044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:38.452044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:38.452044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:38.452044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:38.452044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:38.452044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:38.452044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:38.452044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:38.452044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:38.452044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:38.452044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:38.452044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:38.452044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:38.452044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:38.458094 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:38.458094 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:38.458094 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:38.458094 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:38.458094 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 511/1025] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:38.458590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1239a-e2e9-4c67-99b2-ecd2ca23ff2b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:38.571005 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1239a-e2e9-4c67-99b2-ecd2ca23ff2b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:38.606243 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3176d-dd19-4716-806d-b23289d68941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:38.607175 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3176d-dd19-4716-806d-b23289d68941 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:38.607613 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3176d-dd19-4716-806d-b23289d68941 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:38.607888 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3176d-dd19-4716-806d-b23289d68941 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:38.608620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3176d-dd19-4716-806d-b23289d68941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:38.608923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3176d-dd19-4716-806d-b23289d68941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:38.610313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3176d-dd19-4716-806d-b23289d68941 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:38.623119 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 515/1026] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:38.628673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad46fc-8deb-410c-a9dd-01a89885528d None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:38.728147 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad46fc-8deb-410c-a9dd-01a89885528d None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:38.762234 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f27ca0-430d-4404-9935-1c4ab735e10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:38.763030 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f27ca0-430d-4404-9935-1c4ab735e10d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:38.763283 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f27ca0-430d-4404-9935-1c4ab735e10d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:38.763573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f27ca0-430d-4404-9935-1c4ab735e10d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:38.771252 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f27ca0-430d-4404-9935-1c4ab735e10d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:38.772684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f27ca0-430d-4404-9935-1c4ab735e10d None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:38.786909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-81f27ca0-430d-4404-9935-1c4ab735e10d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 09:48:38.786909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:38.786909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:38.786909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:38.786909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:38.786909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:38.786909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:38.786909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:38.786909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:38.786909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:38.786909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:38.786909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:38.786909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:48:38.786909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:48:38.786909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:48:38.786909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:38.787908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:38.789780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:38.789780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:38.789780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:48:38.789780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:48:38.789780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:48:38.789780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:48:38.789780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:48:38.789780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:48:38.789780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 09:48:38.789780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:38.789780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 512/1027] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 3 09:48:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:38.794246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3176d-dd19-4716-806d-b23289d68941 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:38.894927 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3176d-dd19-4716-806d-b23289d68941 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:38.927965 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df96e2e-0af6-494f-8e39-6023af9922cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:38.928615 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df96e2e-0af6-494f-8e39-6023af9922cc None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:38.928956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df96e2e-0af6-494f-8e39-6023af9922cc None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:38.929290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df96e2e-0af6-494f-8e39-6023af9922cc None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:38.930174 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df96e2e-0af6-494f-8e39-6023af9922cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:38.930492 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df96e2e-0af6-494f-8e39-6023af9922cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:38.931893 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df96e2e-0af6-494f-8e39-6023af9922cc None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:38.948752 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 516/1028] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 3 09:48:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:38.954484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f27ca0-430d-4404-9935-1c4ab735e10d None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:39.051302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f27ca0-430d-4404-9935-1c4ab735e10d None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:39.082882 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c6bcd-505c-4d9c-8209-3ad3e42928fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:39.083529 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c6bcd-505c-4d9c-8209-3ad3e42928fd None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:39.083805 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c6bcd-505c-4d9c-8209-3ad3e42928fd None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:39.084076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c6bcd-505c-4d9c-8209-3ad3e42928fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:39.152340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c6bcd-505c-4d9c-8209-3ad3e42928fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:39.153701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c6bcd-505c-4d9c-8209-3ad3e42928fd None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:39.258576 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 513/1029] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:48:38 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:48:39.264930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df96e2e-0af6-494f-8e39-6023af9922cc None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:39.365771 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df96e2e-0af6-494f-8e39-6023af9922cc None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:39.400789 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa74ef-9576-4222-8e60-59cb11f89e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:39.402010 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa74ef-9576-4222-8e60-59cb11f89e9d None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:39.402566 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa74ef-9576-4222-8e60-59cb11f89e9d None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:39.403051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa74ef-9576-4222-8e60-59cb11f89e9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:39.410261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85bf91-0906-4ed7-a419-96debde630a2 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:39.410555 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85bf91-0906-4ed7-a419-96debde630a2 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:39.410830 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85bf91-0906-4ed7-a419-96debde630a2 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:39.412351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 514/1030] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:48:39.414410 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa74ef-9576-4222-8e60-59cb11f89e9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:39.416062 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa74ef-9576-4222-8e60-59cb11f89e9d None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:39.418016 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d217ac-95d9-4a2e-b91a-e8e9f08c5e7a None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:39.418290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d217ac-95d9-4a2e-b91a-e8e9f08c5e7a None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:39.418565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d217ac-95d9-4a2e-b91a-e8e9f08c5e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:39.434808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-bfaa74ef-9576-4222-8e60-59cb11f89e9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:39.434808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:39.434808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:39.434808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:39.434808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:39.434808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:39.434808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:39.434808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:39.434808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:39.434808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:39.434808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:39.434808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:39.434808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:39.434808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:39.434808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:39.435783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:39.435783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:39.435783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:39.435783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:39.435783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:39.435783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:39.435783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:39.435783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:39.435783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:39.435783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:39.435783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:39.435783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:39.435783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:39.435783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:39.435783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:39.435783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:39.435783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:39.436695 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:39.436695 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:39.436695 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:39.436695 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:39.436929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-c2d217ac-95d9-4a2e-b91a-e8e9f08c5e7a None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:39.436929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-c2d217ac-95d9-4a2e-b91a-e8e9f08c5e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:39.438086 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 517/1031] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:39.443626 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa74ef-9576-4222-8e60-59cb11f89e9d None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:39.503318 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 515/1032] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:48:39.527231 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d217ac-95d9-4a2e-b91a-e8e9f08c5e7a None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:39.542652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa74ef-9576-4222-8e60-59cb11f89e9d None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:39.577670 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcb54e-641b-4a96-8154-e9199185f4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:39.578523 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcb54e-641b-4a96-8154-e9199185f4d0 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:39.578904 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcb54e-641b-4a96-8154-e9199185f4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:39.579252 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcb54e-641b-4a96-8154-e9199185f4d0 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:39.580032 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcb54e-641b-4a96-8154-e9199185f4d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:39.580398 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcb54e-641b-4a96-8154-e9199185f4d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:39.581772 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcb54e-641b-4a96-8154-e9199185f4d0 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:39.593468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 518/1033] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:39.598978 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcb54e-641b-4a96-8154-e9199185f4d0 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:39.626205 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d217ac-95d9-4a2e-b91a-e8e9f08c5e7a None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:39.659777 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc971e1-ff12-4ab3-8921-cfd18063c921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:39.660491 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc971e1-ff12-4ab3-8921-cfd18063c921 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:39.660766 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc971e1-ff12-4ab3-8921-cfd18063c921 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:39.661019 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc971e1-ff12-4ab3-8921-cfd18063c921 None admin] PATH_INFO: `/v3/services/image` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:39.661689 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc971e1-ff12-4ab3-8921-cfd18063c921 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:39.663085 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc971e1-ff12-4ab3-8921-cfd18063c921 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:39.674430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-9fc971e1-ff12-4ab3-8921-cfd18063c921 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 09:48:39.674430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:39.674430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:39.674430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:39.674430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:39.674430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:39.674430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:39.674430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:39.674430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 09:48:39.674430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:39.674430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:39.674430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:39.674430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:39.674430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:39.674430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:39.674430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:39.674430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:39.675687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:39.675687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:39.675687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:39.675687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:39.675687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:39.675687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:39.675687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:39.675687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:39.675687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:39.675687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:39.675687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:39.675687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:39.675687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:39.675687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:39.675687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:39.675687 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:39.676565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:39.676565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:39.676565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:39.676565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:39.676565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:39.676565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:39.676565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:39.676565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:39.676565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:39.676565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:39.676565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:39.676565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:39.676565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 09:48:39.676565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:39.676565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 516/1034] 10.222.0.55 () {56 vars in 1105 bytes} [Tue May 3 09:48:39 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:39.682171 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc971e1-ff12-4ab3-8921-cfd18063c921 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:39.707855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcb54e-641b-4a96-8154-e9199185f4d0 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:39.743990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0adb7-c9ca-4378-b753-63420675eb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:39.744796 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0adb7-c9ca-4378-b753-63420675eb01 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:39.745076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0adb7-c9ca-4378-b753-63420675eb01 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:39.745348 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0adb7-c9ca-4378-b753-63420675eb01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:39.752037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0adb7-c9ca-4378-b753-63420675eb01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:39.753506 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0adb7-c9ca-4378-b753-63420675eb01 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:39.767850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-f8a0adb7-c9ca-4378-b753-63420675eb01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:39.767850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:39.767850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:39.767850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:39.767850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:39.767850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:39.767850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:39.767850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:39.767850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:39.767850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:39.767850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:39.767850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:39.767850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:48:39.767850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:48:39.767850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:48:39.768780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:48:39.768780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:39.768780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:39.768780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:39.768780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:39.768780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:39.768780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:39.768780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:39.768780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:39.768780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:39.768780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:39.768780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:39.768780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:39.768780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:39.768780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:39.768780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:39.768780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:39.769869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:48:39.769869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:48:39.769869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:48:39.769869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:48:39.769869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:48:39.769869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:48:39.769869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:39.769869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:39.769869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 519/1035] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:39.774890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0adb7-c9ca-4378-b753-63420675eb01 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:39.780705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc971e1-ff12-4ab3-8921-cfd18063c921 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:39.817504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c3d93-8934-47aa-bff5-0830a5d73d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:39.818265 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c3d93-8934-47aa-bff5-0830a5d73d16 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:39.818539 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c3d93-8934-47aa-bff5-0830a5d73d16 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:39.818808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c3d93-8934-47aa-bff5-0830a5d73d16 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:39.819506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c3d93-8934-47aa-bff5-0830a5d73d16 None admin] RBAC: Adding query filter params (name=image) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:39.819874 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c3d93-8934-47aa-bff5-0830a5d73d16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:39.821399 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c3d93-8934-47aa-bff5-0830a5d73d16 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:39.830834 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 517/1036] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:39.831507 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c3d93-8934-47aa-bff5-0830a5d73d16 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:39.877388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0adb7-c9ca-4378-b753-63420675eb01 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:39.912451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b233672-9624-4044-95fd-440e949ffabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:39.913024 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b233672-9624-4044-95fd-440e949ffabf None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:39.913441 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b233672-9624-4044-95fd-440e949ffabf None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:39.914301 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b233672-9624-4044-95fd-440e949ffabf None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:39.915100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b233672-9624-4044-95fd-440e949ffabf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:39.915410 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b233672-9624-4044-95fd-440e949ffabf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:39.916838 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b233672-9624-4044-95fd-440e949ffabf None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:39.923499 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c3d93-8934-47aa-bff5-0830a5d73d16 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:39.933339 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 520/1037] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:48:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:39.934449 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b233672-9624-4044-95fd-440e949ffabf None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:39.956374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51915960-5bbe-4422-8a4e-e07594af27d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:39.957053 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51915960-5bbe-4422-8a4e-e07594af27d5 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:39.957304 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51915960-5bbe-4422-8a4e-e07594af27d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:39.957571 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51915960-5bbe-4422-8a4e-e07594af27d5 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:39.958294 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51915960-5bbe-4422-8a4e-e07594af27d5 None admin] RBAC: Adding query filter params (type=image) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:39.958591 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51915960-5bbe-4422-8a4e-e07594af27d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:39.959935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51915960-5bbe-4422-8a4e-e07594af27d5 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:39.969536 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 518/1038] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:39.970567 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51915960-5bbe-4422-8a4e-e07594af27d5 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:40.031020 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b233672-9624-4044-95fd-440e949ffabf None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:40.063257 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180180a-0812-4a84-a055-6971ff9dc727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:40.063976 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180180a-0812-4a84-a055-6971ff9dc727 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:40.064264 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180180a-0812-4a84-a055-6971ff9dc727 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:40.064564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180180a-0812-4a84-a055-6971ff9dc727 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:40.064766 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51915960-5bbe-4422-8a4e-e07594af27d5 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:40.065416 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180180a-0812-4a84-a055-6971ff9dc727 None admin] RBAC: Adding query filter params (role.id=97c22875d1454453affa45b653c6eeed, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=efb008cfc6424998917da60d72689f55) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:40.065730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180180a-0812-4a84-a055-6971ff9dc727 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:40.067231 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180180a-0812-4a84-a055-6971ff9dc727 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:40.073276 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 521/1039] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:48:39 2022] GET /identity/v3/role_assignments?user.id=efb008cfc6424998917da60d72689f55&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=97c22875d1454453affa45b653c6eeed => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:40.103927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fac46-92d2-4578-b456-a203d1882a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:40.104622 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fac46-92d2-4578-b456-a203d1882a75 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:40.104900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fac46-92d2-4578-b456-a203d1882a75 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:40.105245 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fac46-92d2-4578-b456-a203d1882a75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:40.106017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fac46-92d2-4578-b456-a203d1882a75 None admin] RBAC: Adding query filter params (interface=public, service_id=16ca5d0cfc4649b5ad936ac9e1be9882, region_id=RegionOne) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:40.106328 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fac46-92d2-4578-b456-a203d1882a75 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:40.107723 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fac46-92d2-4578-b456-a203d1882a75 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:40.113658 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 519/1040] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 3 09:48:39 2022] GET /identity/v3/endpoints?service_id=16ca5d0cfc4649b5ad936ac9e1be9882&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:40.119380 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180180a-0812-4a84-a055-6971ff9dc727 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:40.229295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180180a-0812-4a84-a055-6971ff9dc727 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:40.268274 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7571765-8875-4e38-b1f8-9a3b8360a4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:40.268982 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7571765-8875-4e38-b1f8-9a3b8360a4e3 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:40.269260 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7571765-8875-4e38-b1f8-9a3b8360a4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:40.270339 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7571765-8875-4e38-b1f8-9a3b8360a4e3 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:40.270339 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7571765-8875-4e38-b1f8-9a3b8360a4e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:40.271614 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7571765-8875-4e38-b1f8-9a3b8360a4e3 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:40.279084 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 522/1041] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 3 09:48:40 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:48:40.664477 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912b492-9816-48d0-aab4-f4bf23e7f0ca None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:40.664869 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912b492-9816-48d0-aab4-f4bf23e7f0ca None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:40.664994 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912b492-9816-48d0-aab4-f4bf23e7f0ca None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:40.666395 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 520/1042] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:40.671835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e00f7-afea-4dde-8af2-90979cf640cd None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:40.672125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e00f7-afea-4dde-8af2-90979cf640cd None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:40.672362 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e00f7-afea-4dde-8af2-90979cf640cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:40.689093 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-6d7e00f7-afea-4dde-8af2-90979cf640cd None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:40.690300 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-6d7e00f7-afea-4dde-8af2-90979cf640cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:40.756265 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 523/1043] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:40.781446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912b492-9816-48d0-aab4-f4bf23e7f0ca None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:40.881631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912b492-9816-48d0-aab4-f4bf23e7f0ca None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:40.913134 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6087f6-5a7f-4db1-b623-dbd700f34c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:40.914264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6087f6-5a7f-4db1-b623-dbd700f34c70 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:40.914595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6087f6-5a7f-4db1-b623-dbd700f34c70 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:40.914803 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6087f6-5a7f-4db1-b623-dbd700f34c70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:40.915968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6087f6-5a7f-4db1-b623-dbd700f34c70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:40.917390 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6087f6-5a7f-4db1-b623-dbd700f34c70 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:40.919172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 521/1044] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:40.924749 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e00f7-afea-4dde-8af2-90979cf640cd None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:41.019800 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e00f7-afea-4dde-8af2-90979cf640cd None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:41.053923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036a5a9-6461-4800-a2e5-46214cc6f863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:41.054850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036a5a9-6461-4800-a2e5-46214cc6f863 None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:41.055094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036a5a9-6461-4800-a2e5-46214cc6f863 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:41.055737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036a5a9-6461-4800-a2e5-46214cc6f863 None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:41.056448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036a5a9-6461-4800-a2e5-46214cc6f863 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:41.057882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036a5a9-6461-4800-a2e5-46214cc6f863 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:41.079664 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 524/1045] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:48:40 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:48:42.283675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62b740-9761-4515-ad60-a0e33dc39dc0 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:42.284221 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62b740-9761-4515-ad60-a0e33dc39dc0 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:42.284221 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62b740-9761-4515-ad60-a0e33dc39dc0 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:42.287645 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 522/1046] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:42.291320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fc6dd-477a-4119-bfe1-6300d22fc552 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:42.291723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fc6dd-477a-4119-bfe1-6300d22fc552 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:42.291901 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fc6dd-477a-4119-bfe1-6300d22fc552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:42.308658 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-994fc6dd-477a-4119-bfe1-6300d22fc552 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:42.309831 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-994fc6dd-477a-4119-bfe1-6300d22fc552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:42.378605 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 525/1047] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:42.401340 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62b740-9761-4515-ad60-a0e33dc39dc0 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:42.512079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62b740-9761-4515-ad60-a0e33dc39dc0 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:42.535419 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0634-8e98-4016-adce-3b47bdf5f8da None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:42.535588 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0634-8e98-4016-adce-3b47bdf5f8da None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:42.535841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0634-8e98-4016-adce-3b47bdf5f8da None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:42.537389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 526/1048] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:42.542309 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad437e82-06a7-4fec-8211-9dd0175ca781 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:42.542596 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad437e82-06a7-4fec-8211-9dd0175ca781 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:42.542873 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad437e82-06a7-4fec-8211-9dd0175ca781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:42.546323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85d3f9-dd50-4d3a-a992-aa2021ffea29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:42.547129 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85d3f9-dd50-4d3a-a992-aa2021ffea29 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:42.547407 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85d3f9-dd50-4d3a-a992-aa2021ffea29 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:42.547865 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85d3f9-dd50-4d3a-a992-aa2021ffea29 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:42.559184 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-ad437e82-06a7-4fec-8211-9dd0175ca781 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:42.560348 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-ad437e82-06a7-4fec-8211-9dd0175ca781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:42.560771 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85d3f9-dd50-4d3a-a992-aa2021ffea29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:48:42.568867 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-bd85d3f9-dd50-4d3a-a992-aa2021ffea29 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 09:48:42.568867 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:42.568867 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:42.568867 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:42.568867 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:42.568867 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:42.568867 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:42.568867 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:42.568867 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:42.568867 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:42.568867 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:42.568867 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:42.568867 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:48:42.568867 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:48:42.568867 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:48:42.568867 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:48:42.569900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:48:42.569900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:48:42.569900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:48:42.569900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:48:42.569900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:42.569900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:42.569900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:42.569900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:42.569900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:42.569900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:42.569900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:42.569900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:42.569900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:42.569900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:42.569900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:42.569900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:42.570968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:42.570968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:42.570968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:42.570968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:42.570968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:48:42.570968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:48:42.570968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:48:42.570968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:48:42.570968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:48:42.570968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:48:42.570968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 09:48:42.570968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:42.570968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 523/1049] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 3 09:48:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:42.576307 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85d3f9-dd50-4d3a-a992-aa2021ffea29 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:42.629966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 527/1050] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:48:42.651652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad437e82-06a7-4fec-8211-9dd0175ca781 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:42.671964 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85d3f9-dd50-4d3a-a992-aa2021ffea29 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:42.703540 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5577ee5-be48-4efa-8e81-0a7d1fa0d6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:42.704225 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5577ee5-be48-4efa-8e81-0a7d1fa0d6a5 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:42.704498 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5577ee5-be48-4efa-8e81-0a7d1fa0d6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:42.704739 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5577ee5-be48-4efa-8e81-0a7d1fa0d6a5 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:42.705502 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5577ee5-be48-4efa-8e81-0a7d1fa0d6a5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:42.705770 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5577ee5-be48-4efa-8e81-0a7d1fa0d6a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:42.707150 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5577ee5-be48-4efa-8e81-0a7d1fa0d6a5 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:42.715238 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 524/1051] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 3 09:48:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:42.721353 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5577ee5-be48-4efa-8e81-0a7d1fa0d6a5 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:42.749887 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad437e82-06a7-4fec-8211-9dd0175ca781 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:42.784070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f04a-2481-4a27-ad63-0cbbd9232afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:42.784854 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f04a-2481-4a27-ad63-0cbbd9232afc None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:42.785127 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f04a-2481-4a27-ad63-0cbbd9232afc None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:42.785392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f04a-2481-4a27-ad63-0cbbd9232afc None admin] PATH_INFO: `/v3/services/image` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:42.786277 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82f04a-2481-4a27-ad63-0cbbd9232afc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:42.788341 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82f04a-2481-4a27-ad63-0cbbd9232afc None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:42.803197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-0f82f04a-2481-4a27-ad63-0cbbd9232afc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 09:48:42.803197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:42.803197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:48:42.803197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:48:42.803197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:48:42.803197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:48:42.803197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:48:42.803197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:42.803197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 09:48:42.803197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:42.803197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:48:42.803197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:42.803197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:42.803197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:42.803197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:42.803197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:42.803197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:42.804819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:42.804819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:42.804819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:42.804819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:42.804819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:42.804819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:42.804819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:48:42.804819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:48:42.804819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:48:42.804819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:48:42.804819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:42.804819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:42.804819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:42.804819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:42.804819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:42.804819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:42.806297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:42.806297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:42.806297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:42.806297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:42.806297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:42.806297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:42.806297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:42.806297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:42.806297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:42.806297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:42.806297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:48:42.806297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:48:42.806297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 09:48:42.806297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:42.806297 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 528/1052] 10.222.0.55 () {56 vars in 1105 bytes} [Tue May 3 09:48:42 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:42.810595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f04a-2481-4a27-ad63-0cbbd9232afc None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:42.819983 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5577ee5-be48-4efa-8e81-0a7d1fa0d6a5 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:42.853590 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f0562-9e09-41e8-8850-65e860902981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:42.854448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f0562-9e09-41e8-8850-65e860902981 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:42.854730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f0562-9e09-41e8-8850-65e860902981 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:42.854999 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f0562-9e09-41e8-8850-65e860902981 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:42.865391 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f0562-9e09-41e8-8850-65e860902981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:42.866931 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f0562-9e09-41e8-8850-65e860902981 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:42.884488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-f38f0562-9e09-41e8-8850-65e860902981 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:42.884488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:42.884488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:42.884488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:42.884488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:42.884488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:42.884488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:42.884488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:42.884488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:42.884488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:42.884488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:42.884488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:42.884488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:42.884488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:42.884488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:42.885518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:42.885518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:42.885518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:42.885518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:42.885518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:42.885518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:42.885518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:42.885518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:42.885518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:42.885518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:42.885518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:42.885518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:42.885518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:42.885518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:42.885518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:42.885518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:42.885518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:42.886443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:42.886443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:42.886443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:42.886443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:42.886443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 525/1053] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:42.891266 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f0562-9e09-41e8-8850-65e860902981 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:42.910044 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f04a-2481-4a27-ad63-0cbbd9232afc None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:42.943380 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274880c4-eb2b-4d83-a646-e98aa905203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:42.944440 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274880c4-eb2b-4d83-a646-e98aa905203a None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:42.944972 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274880c4-eb2b-4d83-a646-e98aa905203a None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:42.945451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274880c4-eb2b-4d83-a646-e98aa905203a None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:42.946393 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274880c4-eb2b-4d83-a646-e98aa905203a None admin] RBAC: Adding query filter params (name=image) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:42.946922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274880c4-eb2b-4d83-a646-e98aa905203a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:42.948452 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274880c4-eb2b-4d83-a646-e98aa905203a None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:42.957991 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 529/1054] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:42.958783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274880c4-eb2b-4d83-a646-e98aa905203a None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:42.985704 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f0562-9e09-41e8-8850-65e860902981 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:43.020464 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa39d68-2a1f-46f0-b767-05916cb039e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:43.021132 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa39d68-2a1f-46f0-b767-05916cb039e9 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:43.021419 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa39d68-2a1f-46f0-b767-05916cb039e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:43.021679 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa39d68-2a1f-46f0-b767-05916cb039e9 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:43.022467 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa39d68-2a1f-46f0-b767-05916cb039e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:43.022879 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa39d68-2a1f-46f0-b767-05916cb039e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:43.024320 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa39d68-2a1f-46f0-b767-05916cb039e9 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:43.037356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 526/1055] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:43.042575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa39d68-2a1f-46f0-b767-05916cb039e9 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:43.059774 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274880c4-eb2b-4d83-a646-e98aa905203a None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:43.091647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fe1e5-88ca-44a8-9575-234291cae527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:43.092307 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe1e5-88ca-44a8-9575-234291cae527 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:43.092581 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe1e5-88ca-44a8-9575-234291cae527 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:43.092846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe1e5-88ca-44a8-9575-234291cae527 None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:43.093549 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fe1e5-88ca-44a8-9575-234291cae527 None admin] RBAC: Adding query filter params (type=image) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:43.093881 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fe1e5-88ca-44a8-9575-234291cae527 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:43.095231 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fe1e5-88ca-44a8-9575-234291cae527 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:43.100108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 530/1056] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:43.105817 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fe1e5-88ca-44a8-9575-234291cae527 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:43.139707 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa39d68-2a1f-46f0-b767-05916cb039e9 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:43.173160 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ed46b-945e-48d4-bdfe-e78924c73938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:43.174016 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed46b-945e-48d4-bdfe-e78924c73938 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:43.174295 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed46b-945e-48d4-bdfe-e78924c73938 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:43.174567 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed46b-945e-48d4-bdfe-e78924c73938 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:43.182942 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ed46b-945e-48d4-bdfe-e78924c73938 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:43.184417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ed46b-945e-48d4-bdfe-e78924c73938 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:43.200621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-c51ed46b-945e-48d4-bdfe-e78924c73938 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 09:48:43.200621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:43.200621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:43.200621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:43.200621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:43.200621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:43.200621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:43.200621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:43.200621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:43.200621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:43.200621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:43.200621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:43.200621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:48:43.200621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:48:43.200621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:48:43.200621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:43.201914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:43.207944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:43.207944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:43.207944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:48:43.207944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:48:43.207944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:48:43.207944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:48:43.207944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:48:43.207944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:48:43.207944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 09:48:43.207944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:43.207944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 527/1057] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 3 09:48:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:43.207944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ed46b-945e-48d4-bdfe-e78924c73938 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:43.216004 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fe1e5-88ca-44a8-9575-234291cae527 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:43.249207 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d811-cedf-4e3b-a9e7-57692c2e4a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:43.250050 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d811-cedf-4e3b-a9e7-57692c2e4a2f None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:43.250332 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d811-cedf-4e3b-a9e7-57692c2e4a2f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:43.253539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d811-cedf-4e3b-a9e7-57692c2e4a2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:43.253539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045d811-cedf-4e3b-a9e7-57692c2e4a2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:43.253539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045d811-cedf-4e3b-a9e7-57692c2e4a2f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:43.273848 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 531/1058] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 3 09:48:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:48:43.313237 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ed46b-945e-48d4-bdfe-e78924c73938 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:43.356691 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fda89-9fbb-4475-b813-db1a571517e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:43.357384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fda89-9fbb-4475-b813-db1a571517e1 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:43.357662 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fda89-9fbb-4475-b813-db1a571517e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:43.357966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fda89-9fbb-4475-b813-db1a571517e1 None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:43.358817 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fda89-9fbb-4475-b813-db1a571517e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:43.359125 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fda89-9fbb-4475-b813-db1a571517e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:43.360611 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fda89-9fbb-4475-b813-db1a571517e1 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:43.373518 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618790-2551-4e8d-9bab-bb67def52af7 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:43.374094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618790-2551-4e8d-9bab-bb67def52af7 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:43.374094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618790-2551-4e8d-9bab-bb67def52af7 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:43.375869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 532/1059] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:43.380907 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 528/1060] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 3 09:48:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:43.382324 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2c97b-082a-4434-9a88-f17023047f6b None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:43.382609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2c97b-082a-4434-9a88-f17023047f6b None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:43.383325 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2c97b-082a-4434-9a88-f17023047f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:43.386971 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fda89-9fbb-4475-b813-db1a571517e1 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:43.401042 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-03d2c97b-082a-4434-9a88-f17023047f6b None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:43.402295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-03d2c97b-082a-4434-9a88-f17023047f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:43.474133 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 533/1061] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:43.494176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fda89-9fbb-4475-b813-db1a571517e1 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:43.499137 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2c97b-082a-4434-9a88-f17023047f6b None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:43.530012 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f2436-fe43-43e5-a96d-0df37ee9a3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:43.530808 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f2436-fe43-43e5-a96d-0df37ee9a3aa None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:43.531090 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f2436-fe43-43e5-a96d-0df37ee9a3aa None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:43.531360 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f2436-fe43-43e5-a96d-0df37ee9a3aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:43.542478 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f2436-fe43-43e5-a96d-0df37ee9a3aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:43.543954 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f2436-fe43-43e5-a96d-0df37ee9a3aa None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:43.564743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-191f2436-fe43-43e5-a96d-0df37ee9a3aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:43.564743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:43.564743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:43.564743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:43.564743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:43.564743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:43.564743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:43.564743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:43.564743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:43.564743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:43.564743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:43.564743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:43.564743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:43.564743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:43.564743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:43.565705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:43.565705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:43.565705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:43.565705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:43.565705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:43.565705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:43.565705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:43.565705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:43.565705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:43.565705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:43.565705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:43.565705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:43.565705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:43.565705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:43.565705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:43.565705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:43.565705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:43.566629 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:43.566629 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:43.566629 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:43.566629 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:43.566629 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 529/1062] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:43.572426 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f2436-fe43-43e5-a96d-0df37ee9a3aa None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:43.605373 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2c97b-082a-4434-9a88-f17023047f6b None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:43.638161 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ba821-deba-48e2-967a-e59b1f3de6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:43.639058 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ba821-deba-48e2-967a-e59b1f3de6ab None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:43.639405 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ba821-deba-48e2-967a-e59b1f3de6ab None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:43.639682 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ba821-deba-48e2-967a-e59b1f3de6ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:43.649548 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ba821-deba-48e2-967a-e59b1f3de6ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:48:43.657205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-091ba821-deba-48e2-967a-e59b1f3de6ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:48:43.657205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:43.657205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:43.657205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:43.657205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:43.657205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:43.657205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:43.657205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:43.657205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:43.657205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:43.657205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:43.657205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:43.657205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:48:43.657205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:48:43.657205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:48:43.657205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:48:43.658246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:48:43.658246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:48:43.658246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:48:43.658246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:48:43.658246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:43.658246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:43.658246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:43.658246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:43.658246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:43.658246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:43.658246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:43.658246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:43.658246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:43.658246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:43.658246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:43.658246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:43.664990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:43.664990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:43.664990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:43.664990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:43.664990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:48:43.664990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:48:43.664990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:48:43.664990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:48:43.664990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:48:43.664990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:48:43.664990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:48:43.664990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:43.664990 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 534/1063] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:48:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:43.667157 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ba821-deba-48e2-967a-e59b1f3de6ab None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:43.674771 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f2436-fe43-43e5-a96d-0df37ee9a3aa None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:43.708525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104a33a-92fa-41a5-a750-0731f4ce6124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:43.709423 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104a33a-92fa-41a5-a750-0731f4ce6124 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:43.709708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104a33a-92fa-41a5-a750-0731f4ce6124 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:43.710015 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104a33a-92fa-41a5-a750-0731f4ce6124 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:43.711320 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104a33a-92fa-41a5-a750-0731f4ce6124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:43.711626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104a33a-92fa-41a5-a750-0731f4ce6124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:43.712989 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104a33a-92fa-41a5-a750-0731f4ce6124 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:43.724220 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 530/1064] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:43.730448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104a33a-92fa-41a5-a750-0731f4ce6124 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:43.772178 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ba821-deba-48e2-967a-e59b1f3de6ab None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:43.811284 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59ee97-ab25-44ee-9a52-e5b012833d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:43.811867 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59ee97-ab25-44ee-9a52-e5b012833d21 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:43.812145 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59ee97-ab25-44ee-9a52-e5b012833d21 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:43.812417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59ee97-ab25-44ee-9a52-e5b012833d21 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:43.813144 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59ee97-ab25-44ee-9a52-e5b012833d21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:43.813447 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59ee97-ab25-44ee-9a52-e5b012833d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:43.814871 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59ee97-ab25-44ee-9a52-e5b012833d21 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:43.822921 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 535/1065] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:48:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:43.828594 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59ee97-ab25-44ee-9a52-e5b012833d21 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:43.832962 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104a33a-92fa-41a5-a750-0731f4ce6124 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:43.867695 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a945c0-89bf-4aa6-b471-ab54d8e615e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:43.868760 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a945c0-89bf-4aa6-b471-ab54d8e615e6 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:43.869185 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a945c0-89bf-4aa6-b471-ab54d8e615e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:43.869624 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a945c0-89bf-4aa6-b471-ab54d8e615e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:43.876190 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a945c0-89bf-4aa6-b471-ab54d8e615e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:43.877611 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a945c0-89bf-4aa6-b471-ab54d8e615e6 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:43.892196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-95a945c0-89bf-4aa6-b471-ab54d8e615e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:43.892196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:43.892196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:43.892196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:43.892196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:43.892196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:43.892196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:43.892196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:43.892196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:43.892196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:43.892196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:43.892196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:43.892196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:48:43.892196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:48:43.892196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:48:43.893138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:48:43.893138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:43.893138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:43.893138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:43.893138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:43.893138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:43.893138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:43.893138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:43.893138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:43.893138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:43.893138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:43.893138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:43.893138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:43.893138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:43.893138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:43.893138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:43.893138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:43.894701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:48:43.894701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:48:43.894701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:48:43.894701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:48:43.894701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:48:43.894701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:48:43.894701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:43.894701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:43.894701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 531/1066] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:43.899374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a945c0-89bf-4aa6-b471-ab54d8e615e6 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:43.925275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59ee97-ab25-44ee-9a52-e5b012833d21 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:43.959581 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fa86f-bea6-4954-94ce-c772d6ca3961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:43.961437 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fa86f-bea6-4954-94ce-c772d6ca3961 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:43.961717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fa86f-bea6-4954-94ce-c772d6ca3961 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:43.962018 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fa86f-bea6-4954-94ce-c772d6ca3961 None admin] PATH_INFO: `/v3/users/4fa038e09a784407b5230021c3de1560` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:43.975725 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fa86f-bea6-4954-94ce-c772d6ca3961 None admin] RBAC: Authorizing `identity:get_user(user_id=4fa038e09a784407b5230021c3de1560)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:43.977530 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fa86f-bea6-4954-94ce-c772d6ca3961 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:43.979428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 536/1067] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:48:43 2022] GET /identity/v3/users/4fa038e09a784407b5230021c3de1560 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:43.984947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fa86f-bea6-4954-94ce-c772d6ca3961 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:43.999595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a945c0-89bf-4aa6-b471-ab54d8e615e6 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:44.038883 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc679519-c6f1-4af0-bdee-25c5345bb5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:44.039680 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc679519-c6f1-4af0-bdee-25c5345bb5de None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:44.039968 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc679519-c6f1-4af0-bdee-25c5345bb5de None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:44.040519 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc679519-c6f1-4af0-bdee-25c5345bb5de None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:44.041578 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc679519-c6f1-4af0-bdee-25c5345bb5de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:44.041912 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc679519-c6f1-4af0-bdee-25c5345bb5de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:44.044053 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc679519-c6f1-4af0-bdee-25c5345bb5de None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:44.062997 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 532/1068] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:48:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:44.063988 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc679519-c6f1-4af0-bdee-25c5345bb5de None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:44.087822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fa86f-bea6-4954-94ce-c772d6ca3961 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:44.122971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ff4dc-339f-4110-b631-59b253770c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:44.123619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ff4dc-339f-4110-b631-59b253770c32 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:44.123896 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ff4dc-339f-4110-b631-59b253770c32 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:44.124160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ff4dc-339f-4110-b631-59b253770c32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:44.166384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc679519-c6f1-4af0-bdee-25c5345bb5de None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:44.189268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ff4dc-339f-4110-b631-59b253770c32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:44.190738 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ff4dc-339f-4110-b631-59b253770c32 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:44.199580 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7564d4-080a-41fb-9b47-6756549bfed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:44.200491 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7564d4-080a-41fb-9b47-6756549bfed9 None admin] REQUEST_METHOD: `PUT` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:44.200759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7564d4-080a-41fb-9b47-6756549bfed9 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:44.201031 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7564d4-080a-41fb-9b47-6756549bfed9 None admin] PATH_INFO: `/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/efb008cfc6424998917da60d72689f55/roles/97c22875d1454453affa45b653c6eeed` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:44.203268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7564d4-080a-41fb-9b47-6756549bfed9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f395f4842c39422d962dbddc4cf2897a, user_id=efb008cfc6424998917da60d72689f55, role_id=97c22875d1454453affa45b653c6eeed)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:44.204727 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7564d4-080a-41fb-9b47-6756549bfed9 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:44.219183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 533/1069] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:48:44 2022] PUT /identity/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/efb008cfc6424998917da60d72689f55/roles/97c22875d1454453affa45b653c6eeed => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:48:44.296330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 537/1070] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:48:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 09:48:44.302244 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7564d4-080a-41fb-9b47-6756549bfed9 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:44.427778 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7564d4-080a-41fb-9b47-6756549bfed9 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:44.466183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a51588-9d95-4e36-9665-1a6add7202a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:44.467049 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a51588-9d95-4e36-9665-1a6add7202a2 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:44.467289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a51588-9d95-4e36-9665-1a6add7202a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:44.467597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a51588-9d95-4e36-9665-1a6add7202a2 None admin] PATH_INFO: `/v3/projects/8d657344e54d4ee19495ae997bd6ec37` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:44.468762 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a51588-9d95-4e36-9665-1a6add7202a2 None admin] RBAC: Authorizing `identity:get_project(project_id=8d657344e54d4ee19495ae997bd6ec37)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:44.470231 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a51588-9d95-4e36-9665-1a6add7202a2 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:44.476966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 534/1071] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:48:44 2022] GET /identity/v3/projects/8d657344e54d4ee19495ae997bd6ec37 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:44.478381 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ff4dc-339f-4110-b631-59b253770c32 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:44.575698 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ff4dc-339f-4110-b631-59b253770c32 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:44.609725 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16c924-793b-4b61-9057-3084bb16b5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:44.610393 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16c924-793b-4b61-9057-3084bb16b5b5 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:44.610665 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16c924-793b-4b61-9057-3084bb16b5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:44.610930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16c924-793b-4b61-9057-3084bb16b5b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:44.611750 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16c924-793b-4b61-9057-3084bb16b5b5 None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=8d657344e54d4ee19495ae997bd6ec37, user.id=4fa038e09a784407b5230021c3de1560) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:44.612058 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16c924-793b-4b61-9057-3084bb16b5b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:44.613473 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16c924-793b-4b61-9057-3084bb16b5b5 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:44.619206 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 538/1072] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:48:44 2022] GET /identity/v3/role_assignments?user.id=4fa038e09a784407b5230021c3de1560&scope.project.id=8d657344e54d4ee19495ae997bd6ec37&role.id=52d3ad3e32c741938997691c9a909b81 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:45.524680 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766c64b-8e69-40f8-b87b-b825e06fc8cc None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:45.525203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766c64b-8e69-40f8-b87b-b825e06fc8cc None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:45.525203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766c64b-8e69-40f8-b87b-b825e06fc8cc None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:45.526823 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 535/1073] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:45.531978 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf20470-f33e-44db-a497-47920d5cffd6 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:45.532366 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf20470-f33e-44db-a497-47920d5cffd6 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:45.532611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf20470-f33e-44db-a497-47920d5cffd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:45.550491 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-5bf20470-f33e-44db-a497-47920d5cffd6 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:45.551596 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-5bf20470-f33e-44db-a497-47920d5cffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:45.620876 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 539/1074] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:45.644148 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766c64b-8e69-40f8-b87b-b825e06fc8cc None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:45.747806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766c64b-8e69-40f8-b87b-b825e06fc8cc None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:45.780076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c5085-960a-426f-b946-f29540b0b8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:45.780711 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c5085-960a-426f-b946-f29540b0b8c8 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:45.780984 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c5085-960a-426f-b946-f29540b0b8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:45.781245 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c5085-960a-426f-b946-f29540b0b8c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:45.846099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c5085-960a-426f-b946-f29540b0b8c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:45.847609 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c5085-960a-426f-b946-f29540b0b8c8 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:45.941021 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 536/1075] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:48:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:48:45.946796 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf20470-f33e-44db-a497-47920d5cffd6 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:46.042208 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf20470-f33e-44db-a497-47920d5cffd6 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:46.076915 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c4b27-a99b-47ed-a264-9b05d6be5d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:46.077715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c4b27-a99b-47ed-a264-9b05d6be5d76 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:46.078014 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c4b27-a99b-47ed-a264-9b05d6be5d76 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:46.078286 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c4b27-a99b-47ed-a264-9b05d6be5d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:46.088299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c4b27-a99b-47ed-a264-9b05d6be5d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:46.089737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c4b27-a99b-47ed-a264-9b05d6be5d76 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:46.106930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-5c8c4b27-a99b-47ed-a264-9b05d6be5d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:46.106930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:46.106930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:46.106930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:46.106930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:46.106930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:46.106930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:46.106930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:46.106930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:46.106930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:46.106930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:46.106930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:46.106930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:46.106930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:46.106930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:46.107890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:46.107890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:46.107890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:46.107890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:46.107890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:46.107890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:46.107890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:46.107890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:46.107890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:46.107890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:46.107890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:46.107890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:46.107890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:46.107890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:46.107890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:46.107890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:46.107890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:46.109289 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:46.109289 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:46.109289 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:46.109289 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:46.109289 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 540/1076] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:46.115037 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c5085-960a-426f-b946-f29540b0b8c8 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:46.209347 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c5085-960a-426f-b946-f29540b0b8c8 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:46.242130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a63c4-ad75-4d5e-9aa1-7f7af4283804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:46.242791 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a63c4-ad75-4d5e-9aa1-7f7af4283804 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:46.243065 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a63c4-ad75-4d5e-9aa1-7f7af4283804 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:46.243328 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a63c4-ad75-4d5e-9aa1-7f7af4283804 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:46.244032 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a63c4-ad75-4d5e-9aa1-7f7af4283804 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:46.244327 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a63c4-ad75-4d5e-9aa1-7f7af4283804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:46.245683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a63c4-ad75-4d5e-9aa1-7f7af4283804 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:46.259102 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 537/1077] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:46.460241 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845750a0-e00f-4167-991b-904aa2ed9ee6 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:46.460598 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845750a0-e00f-4167-991b-904aa2ed9ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:46.460907 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845750a0-e00f-4167-991b-904aa2ed9ee6 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:46.462372 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 541/1078] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:46.467787 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9e6ec-0da8-4550-9a4a-4fed188bd6dd None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:46.468073 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9e6ec-0da8-4550-9a4a-4fed188bd6dd None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:46.468341 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9e6ec-0da8-4550-9a4a-4fed188bd6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:46.485638 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-66e9e6ec-0da8-4550-9a4a-4fed188bd6dd None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:46.486830 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-66e9e6ec-0da8-4550-9a4a-4fed188bd6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:46.555919 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 538/1079] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:46.579134 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845750a0-e00f-4167-991b-904aa2ed9ee6 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:46.679327 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845750a0-e00f-4167-991b-904aa2ed9ee6 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:46.714479 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358f84d-0899-43c9-ae11-bb8db407c10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:46.715189 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358f84d-0899-43c9-ae11-bb8db407c10c None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:46.715464 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358f84d-0899-43c9-ae11-bb8db407c10c None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:46.715728 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358f84d-0899-43c9-ae11-bb8db407c10c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:46.726026 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358f84d-0899-43c9-ae11-bb8db407c10c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:48:46.734126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-6358f84d-0899-43c9-ae11-bb8db407c10c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 09:48:46.734126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:46.734126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:46.734126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:46.734126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:46.734126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:46.734126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:46.734126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:46.734126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:46.734126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:46.734126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:46.734126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:46.734126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:48:46.734126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:48:46.734126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:48:46.734126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:48:46.735060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:48:46.735060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:48:46.735060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:48:46.735060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:48:46.735060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:46.735060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:46.735060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:46.735060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:46.735060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:46.735060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:46.735060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:46.735060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:46.735060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:46.735060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:46.735060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:46.735060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:46.735971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:46.735971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:46.735971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:46.735971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:46.735971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:48:46.735971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:48:46.735971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:48:46.735971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:48:46.735971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:48:46.735971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:48:46.735971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 09:48:46.735971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:46.735971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 542/1080] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 3 09:48:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:46.741488 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9e6ec-0da8-4550-9a4a-4fed188bd6dd None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:46.840086 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a6119-fec0-4842-880b-3794ea1e8d7a None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:46.840401 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a6119-fec0-4842-880b-3794ea1e8d7a None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:46.840666 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a6119-fec0-4842-880b-3794ea1e8d7a None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:46.842149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 543/1081] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:46.842284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9e6ec-0da8-4550-9a4a-4fed188bd6dd None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:46.847143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139af1ef-1038-4200-879c-06a09a9736b2 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:46.847428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139af1ef-1038-4200-879c-06a09a9736b2 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:46.847704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139af1ef-1038-4200-879c-06a09a9736b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:46.864203 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-139af1ef-1038-4200-879c-06a09a9736b2 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:46.865365 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-139af1ef-1038-4200-879c-06a09a9736b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:46.879425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17b22e-3959-4f09-a438-b8e6f4abffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:46.880083 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17b22e-3959-4f09-a438-b8e6f4abffcc None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:46.880350 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17b22e-3959-4f09-a438-b8e6f4abffcc None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:46.880620 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17b22e-3959-4f09-a438-b8e6f4abffcc None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:46.881363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17b22e-3959-4f09-a438-b8e6f4abffcc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:46.881664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17b22e-3959-4f09-a438-b8e6f4abffcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:46.883259 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17b22e-3959-4f09-a438-b8e6f4abffcc None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:46.891458 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 539/1082] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 3 09:48:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:46.897092 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17b22e-3959-4f09-a438-b8e6f4abffcc None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:46.929594 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 544/1083] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:48:46.951662 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139af1ef-1038-4200-879c-06a09a9736b2 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:46.992157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17b22e-3959-4f09-a438-b8e6f4abffcc None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:47.027405 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962ba99-c919-49c4-9bdd-2bce910cc83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:47.028197 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962ba99-c919-49c4-9bdd-2bce910cc83a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:47.028468 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962ba99-c919-49c4-9bdd-2bce910cc83a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:47.028734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962ba99-c919-49c4-9bdd-2bce910cc83a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:47.039576 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962ba99-c919-49c4-9bdd-2bce910cc83a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:47.041002 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962ba99-c919-49c4-9bdd-2bce910cc83a None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:47.056939 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139af1ef-1038-4200-879c-06a09a9736b2 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:47.057475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-7962ba99-c919-49c4-9bdd-2bce910cc83a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:47.057475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:47.057475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:47.057475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:47.057475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:47.057475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:47.057475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:47.057475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:47.057475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:47.057475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:47.057475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:47.057475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:47.057475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:47.057475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:47.057475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:47.058459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:47.058459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:47.058459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:47.058459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:47.058459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:47.058459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:47.058459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:47.058459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:47.058459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:47.058459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:47.058459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:47.058459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:47.058459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:47.058459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:47.058459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:47.058459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:47.058459 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:47.059357 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:47.059357 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:47.059357 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:47.059357 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:47.059357 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 540/1084] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:47.064313 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962ba99-c919-49c4-9bdd-2bce910cc83a None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:47.090739 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d897a-3c28-4f79-8879-9e5afe1b1825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:47.091523 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d897a-3c28-4f79-8879-9e5afe1b1825 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:47.091830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d897a-3c28-4f79-8879-9e5afe1b1825 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:47.092097 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d897a-3c28-4f79-8879-9e5afe1b1825 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:47.101995 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d897a-3c28-4f79-8879-9e5afe1b1825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:48:47.109558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-335d897a-3c28-4f79-8879-9e5afe1b1825 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:48:47.109558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:47.109558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:47.109558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:47.109558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:47.109558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:47.109558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:47.109558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:47.109558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:47.109558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:47.109558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:47.109558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:47.109558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:48:47.109558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:48:47.109558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:48:47.109558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:48:47.110551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:48:47.110551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:48:47.110551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:48:47.110551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:48:47.110551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:47.110551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:47.110551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:47.110551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:47.110551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:47.110551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:47.110551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:47.110551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:47.110551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:47.110551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:47.110551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:47.110551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:47.111392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:47.111392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:47.111392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:47.111392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:47.111392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:48:47.111392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:48:47.111392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:48:47.111392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:48:47.111392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:48:47.111392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:48:47.111392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:48:47.111392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:47.111392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 545/1085] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:48:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:47.117017 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d897a-3c28-4f79-8879-9e5afe1b1825 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:47.163801 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962ba99-c919-49c4-9bdd-2bce910cc83a None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:47.194875 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cd5fd-73f2-4fe0-8d15-50c6f219f219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:47.195523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cd5fd-73f2-4fe0-8d15-50c6f219f219 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:47.195801 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cd5fd-73f2-4fe0-8d15-50c6f219f219 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:47.196071 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cd5fd-73f2-4fe0-8d15-50c6f219f219 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:47.196763 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cd5fd-73f2-4fe0-8d15-50c6f219f219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:47.197066 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cd5fd-73f2-4fe0-8d15-50c6f219f219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:47.198464 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cd5fd-73f2-4fe0-8d15-50c6f219f219 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:47.209828 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 541/1086] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:47.215480 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cd5fd-73f2-4fe0-8d15-50c6f219f219 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:47.215637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d897a-3c28-4f79-8879-9e5afe1b1825 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:47.253666 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d027747-f5bc-4c4c-9dac-8beffce081a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:47.254286 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d027747-f5bc-4c4c-9dac-8beffce081a3 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:47.254569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d027747-f5bc-4c4c-9dac-8beffce081a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:47.254840 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d027747-f5bc-4c4c-9dac-8beffce081a3 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:47.255586 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d027747-f5bc-4c4c-9dac-8beffce081a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:47.255894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d027747-f5bc-4c4c-9dac-8beffce081a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:47.257388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d027747-f5bc-4c4c-9dac-8beffce081a3 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:47.266048 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 546/1087] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:48:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:47.272486 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d027747-f5bc-4c4c-9dac-8beffce081a3 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:47.316839 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cd5fd-73f2-4fe0-8d15-50c6f219f219 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:47.351168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d528a1-d2fa-4b09-b889-4ca74d5edd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:47.351974 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d528a1-d2fa-4b09-b889-4ca74d5edd61 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:47.352254 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d528a1-d2fa-4b09-b889-4ca74d5edd61 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:47.352523 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d528a1-d2fa-4b09-b889-4ca74d5edd61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:47.359622 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d528a1-d2fa-4b09-b889-4ca74d5edd61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:47.361058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d528a1-d2fa-4b09-b889-4ca74d5edd61 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:47.373921 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d027747-f5bc-4c4c-9dac-8beffce081a3 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:47.375675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-a3d528a1-d2fa-4b09-b889-4ca74d5edd61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 09:48:47.375675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:47.375675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:47.375675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:47.375675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:47.375675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:47.375675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:47.375675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:47.375675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:47.375675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:47.375675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:47.375675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:47.375675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:48:47.375675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:48:47.375675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:48:47.375675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:47.376653 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:47.377764 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:47.377764 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:47.377764 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:48:47.377764 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:48:47.377764 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:48:47.377764 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:48:47.377764 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:48:47.377764 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:48:47.377764 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 09:48:47.377764 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:47.377764 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 542/1088] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 3 09:48:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:48:47.382814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d528a1-d2fa-4b09-b889-4ca74d5edd61 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:47.408547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8871a-20ee-4327-857d-1a4edbb426b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:47.409420 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8871a-20ee-4327-857d-1a4edbb426b5 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:47.409698 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8871a-20ee-4327-857d-1a4edbb426b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:47.409996 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8871a-20ee-4327-857d-1a4edbb426b5 None admin] PATH_INFO: `/v3/users/4fa038e09a784407b5230021c3de1560` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:47.411276 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8871a-20ee-4327-857d-1a4edbb426b5 None admin] RBAC: Authorizing `identity:get_user(user_id=4fa038e09a784407b5230021c3de1560)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:47.412703 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8871a-20ee-4327-857d-1a4edbb426b5 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:47.414787 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 547/1089] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:48:47 2022] GET /identity/v3/users/4fa038e09a784407b5230021c3de1560 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:47.420392 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8871a-20ee-4327-857d-1a4edbb426b5 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:47.478431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d528a1-d2fa-4b09-b889-4ca74d5edd61 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:47.511940 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8871a-20ee-4327-857d-1a4edbb426b5 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:47.512436 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad00891-0cad-406b-8c5d-f5890207594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:47.513101 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad00891-0cad-406b-8c5d-f5890207594c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:47.513380 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad00891-0cad-406b-8c5d-f5890207594c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:47.513655 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad00891-0cad-406b-8c5d-f5890207594c None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:47.514518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad00891-0cad-406b-8c5d-f5890207594c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:47.514825 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad00891-0cad-406b-8c5d-f5890207594c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:47.516248 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad00891-0cad-406b-8c5d-f5890207594c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:47.533828 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 543/1090] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 3 09:48:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:47.539773 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad00891-0cad-406b-8c5d-f5890207594c None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:47.543702 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3dde5-7db8-4fb4-8920-1703fa5244bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:47.544558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3dde5-7db8-4fb4-8920-1703fa5244bb None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:47.544835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3dde5-7db8-4fb4-8920-1703fa5244bb None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:47.545107 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3dde5-7db8-4fb4-8920-1703fa5244bb None admin] PATH_INFO: `/v3/projects/8d657344e54d4ee19495ae997bd6ec37` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:47.546345 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3dde5-7db8-4fb4-8920-1703fa5244bb None admin] RBAC: Authorizing `identity:get_project(project_id=8d657344e54d4ee19495ae997bd6ec37)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:47.547777 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3dde5-7db8-4fb4-8920-1703fa5244bb None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:47.549475 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 548/1091] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:48:47 2022] GET /identity/v3/projects/8d657344e54d4ee19495ae997bd6ec37 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:48:47.555341 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3dde5-7db8-4fb4-8920-1703fa5244bb None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:47.637365 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad00891-0cad-406b-8c5d-f5890207594c None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:47.653559 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3dde5-7db8-4fb4-8920-1703fa5244bb None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:47.670665 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee2f46-aaa1-47a4-95cb-006fc64e3a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:47.671299 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee2f46-aaa1-47a4-95cb-006fc64e3a27 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:47.671646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee2f46-aaa1-47a4-95cb-006fc64e3a27 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:47.671911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee2f46-aaa1-47a4-95cb-006fc64e3a27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:47.685382 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144a9e5-da25-4402-9782-bb1853738849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:47.686393 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144a9e5-da25-4402-9782-bb1853738849 None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:47.686749 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144a9e5-da25-4402-9782-bb1853738849 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:47.687026 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144a9e5-da25-4402-9782-bb1853738849 None admin] PATH_INFO: `/v3/projects/8d657344e54d4ee19495ae997bd6ec37/users/4fa038e09a784407b5230021c3de1560/roles/52d3ad3e32c741938997691c9a909b81` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:47.689021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144a9e5-da25-4402-9782-bb1853738849 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d657344e54d4ee19495ae997bd6ec37, user_id=4fa038e09a784407b5230021c3de1560, role_id=52d3ad3e32c741938997691c9a909b81)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:47.690489 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144a9e5-da25-4402-9782-bb1853738849 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:47.706072 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 549/1092] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:48:47 2022] PUT /identity/v3/projects/8d657344e54d4ee19495ae997bd6ec37/users/4fa038e09a784407b5230021c3de1560/roles/52d3ad3e32c741938997691c9a909b81 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:48:47.740361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee2f46-aaa1-47a4-95cb-006fc64e3a27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:47.741966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee2f46-aaa1-47a4-95cb-006fc64e3a27 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:47.848024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 544/1093] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:48:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 09:48:47.854232 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144a9e5-da25-4402-9782-bb1853738849 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:47.957171 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144a9e5-da25-4402-9782-bb1853738849 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:47.990463 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d395c73-9540-43d9-8b88-5f8521dba430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:47.991242 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d395c73-9540-43d9-8b88-5f8521dba430 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:47.991564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d395c73-9540-43d9-8b88-5f8521dba430 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:47.991945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d395c73-9540-43d9-8b88-5f8521dba430 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:48.002497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d395c73-9540-43d9-8b88-5f8521dba430 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:48.003926 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d395c73-9540-43d9-8b88-5f8521dba430 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:48.020979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-8d395c73-9540-43d9-8b88-5f8521dba430 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:48.020979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:48.020979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:48.020979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:48.020979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:48.020979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:48.020979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:48.020979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:48.020979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:48.020979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:48.020979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:48.020979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:48.020979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:48:48.020979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:48:48.020979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:48:48.021945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:48:48.021945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:48.021945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:48.021945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:48.021945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:48.021945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:48.021945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:48.021945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:48.021945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:48.021945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:48.021945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:48.021945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:48.021945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:48.021945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:48.021945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:48.021945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:48.021945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:48.022883 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:48:48.022883 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:48:48.022883 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:48:48.022883 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:48.022883 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 550/1094] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:48.028180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee2f46-aaa1-47a4-95cb-006fc64e3a27 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:48.123597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee2f46-aaa1-47a4-95cb-006fc64e3a27 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:48.156768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8bd6e-c07c-4fdb-b1ad-eea549f73911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:48.157404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8bd6e-c07c-4fdb-b1ad-eea549f73911 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:48.157680 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8bd6e-c07c-4fdb-b1ad-eea549f73911 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:48.157971 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8bd6e-c07c-4fdb-b1ad-eea549f73911 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:48.158681 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8bd6e-c07c-4fdb-b1ad-eea549f73911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:48.158978 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8bd6e-c07c-4fdb-b1ad-eea549f73911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:48.160327 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8bd6e-c07c-4fdb-b1ad-eea549f73911 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:48.171749 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 545/1095] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:48.177609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d395c73-9540-43d9-8b88-5f8521dba430 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:48.273477 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d395c73-9540-43d9-8b88-5f8521dba430 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:48.308761 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e179f5-5db4-41bf-bd2a-74604c4303e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:48.309551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e179f5-5db4-41bf-bd2a-74604c4303e1 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:48.309846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e179f5-5db4-41bf-bd2a-74604c4303e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:48.310120 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e179f5-5db4-41bf-bd2a-74604c4303e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:48.316792 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e179f5-5db4-41bf-bd2a-74604c4303e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:48.318286 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e179f5-5db4-41bf-bd2a-74604c4303e1 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:48.332971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-49e179f5-5db4-41bf-bd2a-74604c4303e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:48.332971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:48.332971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:48.332971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:48.332971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:48.332971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:48.332971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:48.332971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:48.332971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:48.332971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:48.332971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:48.332971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:48.332971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:48:48.332971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:48:48.332971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:48:48.333962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:48:48.333962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:48.333962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:48.333962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:48.333962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:48.333962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:48.333962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:48.333962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:48.333962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:48:48.333962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:48.333962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:48.333962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:48.333962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:48.333962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:48.333962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:48.333962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:48.333962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:48.334914 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:48:48.334914 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:48:48.334914 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:48:48.334914 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:48:48.334914 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:48:48.334914 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:48:48.334914 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:48:48.334914 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:48:48.334914 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 551/1096] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:48:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:48.340754 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8bd6e-c07c-4fdb-b1ad-eea549f73911 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:48.437524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8bd6e-c07c-4fdb-b1ad-eea549f73911 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:48.470509 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1e27d-2a7a-47f2-9181-bdd245beecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:48.471156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1e27d-2a7a-47f2-9181-bdd245beecaa None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:48.471438 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1e27d-2a7a-47f2-9181-bdd245beecaa None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:48.471709 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1e27d-2a7a-47f2-9181-bdd245beecaa None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:48.472484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1e27d-2a7a-47f2-9181-bdd245beecaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:48.472787 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1e27d-2a7a-47f2-9181-bdd245beecaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:48.474223 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1e27d-2a7a-47f2-9181-bdd245beecaa None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:48.486282 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 546/1097] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:48:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:48.492954 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e179f5-5db4-41bf-bd2a-74604c4303e1 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:48.589356 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e179f5-5db4-41bf-bd2a-74604c4303e1 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:48.622617 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d240db-fce9-4dbd-a3f1-f16fb0e3db9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:48.623254 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d240db-fce9-4dbd-a3f1-f16fb0e3db9e None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:48.623532 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d240db-fce9-4dbd-a3f1-f16fb0e3db9e None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:48.623791 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d240db-fce9-4dbd-a3f1-f16fb0e3db9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:48.624616 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d240db-fce9-4dbd-a3f1-f16fb0e3db9e None admin] RBAC: Adding query filter params (role.id=97c22875d1454453affa45b653c6eeed, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=efb008cfc6424998917da60d72689f55) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:48.624923 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d240db-fce9-4dbd-a3f1-f16fb0e3db9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:48.626370 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d240db-fce9-4dbd-a3f1-f16fb0e3db9e None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:48.632339 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 552/1098] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:48:48 2022] GET /identity/v3/role_assignments?user.id=efb008cfc6424998917da60d72689f55&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=97c22875d1454453affa45b653c6eeed => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:49.926935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6767-fa82-49f3-9a5a-e982648f735a None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:49.927492 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6767-fa82-49f3-9a5a-e982648f735a None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:49.927492 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6767-fa82-49f3-9a5a-e982648f735a None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:49.928782 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 547/1099] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:49.935311 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360504c-c316-4f4b-a50a-1aa6aabd7f9e None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:49.936024 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360504c-c316-4f4b-a50a-1aa6aabd7f9e None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:49.936186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360504c-c316-4f4b-a50a-1aa6aabd7f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:49.962306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-6360504c-c316-4f4b-a50a-1aa6aabd7f9e None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:49.963485 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-6360504c-c316-4f4b-a50a-1aa6aabd7f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:50.028849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 553/1100] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:50.063489 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd6767-fa82-49f3-9a5a-e982648f735a None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:50.176606 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd6767-fa82-49f3-9a5a-e982648f735a None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:50.213180 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d552c9d-dcd6-4703-b66b-c68d384ad6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:50.213918 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d552c9d-dcd6-4703-b66b-c68d384ad6f3 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:50.214190 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d552c9d-dcd6-4703-b66b-c68d384ad6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:50.214457 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d552c9d-dcd6-4703-b66b-c68d384ad6f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:50.225408 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d552c9d-dcd6-4703-b66b-c68d384ad6f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:48:50.232976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-8d552c9d-dcd6-4703-b66b-c68d384ad6f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:48:50.232976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:48:50.232976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:48:50.232976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:48:50.232976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:48:50.232976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:48:50.232976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:48:50.232976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:48:50.232976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:48:50.232976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:48:50.232976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:48:50.232976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:48:50.232976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:48:50.232976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:48:50.232976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:48:50.232976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:48:50.234056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:48:50.234056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:48:50.234056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:48:50.234056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:48:50.234056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:48:50.234056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:48:50.234056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:48:50.234056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:48:50.234056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:48:50.234056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:48:50.234056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:48:50.234056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:48:50.234056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:48:50.234056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:48:50.234056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:48:50.234056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:48:50.235109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:48:50.235109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:48:50.235109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:48:50.235109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:48:50.235109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:48:50.235109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:48:50.235109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:48:50.235109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:48:50.235109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:48:50.235109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:48:50.235109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:48:50.235109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:48:50.235109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 548/1101] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:48:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:48:50.240902 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360504c-c316-4f4b-a50a-1aa6aabd7f9e None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:50.338661 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360504c-c316-4f4b-a50a-1aa6aabd7f9e None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:50.372984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2344a5e-4909-4d15-b09b-9da1e9427329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:50.374143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2344a5e-4909-4d15-b09b-9da1e9427329 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:50.374419 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2344a5e-4909-4d15-b09b-9da1e9427329 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:50.374674 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2344a5e-4909-4d15-b09b-9da1e9427329 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:50.375412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2344a5e-4909-4d15-b09b-9da1e9427329 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:50.375712 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2344a5e-4909-4d15-b09b-9da1e9427329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:50.377072 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2344a5e-4909-4d15-b09b-9da1e9427329 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:50.385706 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 554/1102] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:48:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:50.394855 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d552c9d-dcd6-4703-b66b-c68d384ad6f3 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:50.505216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d552c9d-dcd6-4703-b66b-c68d384ad6f3 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:50.538413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35713cd-4eb8-4464-a5d9-20de204d1139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:50.539270 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35713cd-4eb8-4464-a5d9-20de204d1139 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:50.539553 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35713cd-4eb8-4464-a5d9-20de204d1139 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:50.539819 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35713cd-4eb8-4464-a5d9-20de204d1139 None admin] PATH_INFO: `/v3/users/4fa038e09a784407b5230021c3de1560` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:50.541019 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35713cd-4eb8-4464-a5d9-20de204d1139 None admin] RBAC: Authorizing `identity:get_user(user_id=4fa038e09a784407b5230021c3de1560)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:50.542498 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35713cd-4eb8-4464-a5d9-20de204d1139 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:50.544102 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 549/1103] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:48:50 2022] GET /identity/v3/users/4fa038e09a784407b5230021c3de1560 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:50.553270 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2344a5e-4909-4d15-b09b-9da1e9427329 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:50.651531 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2344a5e-4909-4d15-b09b-9da1e9427329 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:50.685183 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d87d9-19f5-4432-821e-eb1bbf542643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:50.685839 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d87d9-19f5-4432-821e-eb1bbf542643 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:50.686108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d87d9-19f5-4432-821e-eb1bbf542643 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:50.686377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d87d9-19f5-4432-821e-eb1bbf542643 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:50.759555 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d87d9-19f5-4432-821e-eb1bbf542643 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:50.761702 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d87d9-19f5-4432-821e-eb1bbf542643 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:50.864989 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 555/1104] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:48:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:48:50.874080 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35713cd-4eb8-4464-a5d9-20de204d1139 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:50.970316 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35713cd-4eb8-4464-a5d9-20de204d1139 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:51.012416 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc15b4-75f4-404b-bab2-9a188be38c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:51.013234 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc15b4-75f4-404b-bab2-9a188be38c9f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:51.013490 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc15b4-75f4-404b-bab2-9a188be38c9f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:51.013752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc15b4-75f4-404b-bab2-9a188be38c9f None admin] PATH_INFO: `/v3/projects/8d657344e54d4ee19495ae997bd6ec37` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:51.015097 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc15b4-75f4-404b-bab2-9a188be38c9f None admin] RBAC: Authorizing `identity:get_project(project_id=8d657344e54d4ee19495ae997bd6ec37)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:51.016518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc15b4-75f4-404b-bab2-9a188be38c9f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:51.018203 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 550/1105] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:48:50 2022] GET /identity/v3/projects/8d657344e54d4ee19495ae997bd6ec37 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:51.025002 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d87d9-19f5-4432-821e-eb1bbf542643 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:51.142311 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d87d9-19f5-4432-821e-eb1bbf542643 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:51.176496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e500d8-8c5e-455d-8dc5-ceecc10c6e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:51.177136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e500d8-8c5e-455d-8dc5-ceecc10c6e15 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:51.177414 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e500d8-8c5e-455d-8dc5-ceecc10c6e15 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:51.177685 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e500d8-8c5e-455d-8dc5-ceecc10c6e15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:51.178542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e500d8-8c5e-455d-8dc5-ceecc10c6e15 None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=8d657344e54d4ee19495ae997bd6ec37, user.id=4fa038e09a784407b5230021c3de1560) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:51.178853 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e500d8-8c5e-455d-8dc5-ceecc10c6e15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:51.180418 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e500d8-8c5e-455d-8dc5-ceecc10c6e15 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:51.186088 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 556/1106] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:48:51 2022] GET /identity/v3/role_assignments?user.id=4fa038e09a784407b5230021c3de1560&scope.project.id=8d657344e54d4ee19495ae997bd6ec37&role.id=52d3ad3e32c741938997691c9a909b81 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:53.408024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f8cdc-3769-4361-b816-b4a112fe8f62 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:53.408935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f8cdc-3769-4361-b816-b4a112fe8f62 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:53.408935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f8cdc-3769-4361-b816-b4a112fe8f62 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:53.411134 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 551/1107] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:53.417479 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1895b-e714-45ba-be3e-196c06d099c8 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:53.417938 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1895b-e714-45ba-be3e-196c06d099c8 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:53.418030 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1895b-e714-45ba-be3e-196c06d099c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:53.446045 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-61f1895b-e714-45ba-be3e-196c06d099c8 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:53.447229 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-61f1895b-e714-45ba-be3e-196c06d099c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:53.518784 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 557/1108] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:53.545977 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f8cdc-3769-4361-b816-b4a112fe8f62 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:53.661178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f8cdc-3769-4361-b816-b4a112fe8f62 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:53.702928 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d7e4c-6a19-42e5-a8fe-76635da1dd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:53.703702 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d7e4c-6a19-42e5-a8fe-76635da1dd06 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:53.703979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d7e4c-6a19-42e5-a8fe-76635da1dd06 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:53.704247 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d7e4c-6a19-42e5-a8fe-76635da1dd06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:53.705448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d7e4c-6a19-42e5-a8fe-76635da1dd06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:53.706898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d7e4c-6a19-42e5-a8fe-76635da1dd06 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:53.708489 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 552/1109] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:48:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:53.715115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1895b-e714-45ba-be3e-196c06d099c8 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:53.828181 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1895b-e714-45ba-be3e-196c06d099c8 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:53.863332 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e26ac8-12ab-4ba2-ad09-0f5db2e2ab45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:53.863993 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e26ac8-12ab-4ba2-ad09-0f5db2e2ab45 None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:53.864259 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e26ac8-12ab-4ba2-ad09-0f5db2e2ab45 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:53.864544 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e26ac8-12ab-4ba2-ad09-0f5db2e2ab45 None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:53.865249 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e26ac8-12ab-4ba2-ad09-0f5db2e2ab45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:53.866747 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e26ac8-12ab-4ba2-ad09-0f5db2e2ab45 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:53.889529 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 558/1110] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:48:53 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:48:56.167406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191434ee-78ab-4855-b958-1ced2479214a None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:56.167993 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191434ee-78ab-4855-b958-1ced2479214a None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:56.167993 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191434ee-78ab-4855-b958-1ced2479214a None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:56.169318 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 553/1111] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:56.175608 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcc9fc-7fe8-4acd-927d-63088b5cfb41 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:56.176346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcc9fc-7fe8-4acd-927d-63088b5cfb41 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:56.176509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcc9fc-7fe8-4acd-927d-63088b5cfb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:56.201110 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-f2fcc9fc-7fe8-4acd-927d-63088b5cfb41 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:56.202301 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-f2fcc9fc-7fe8-4acd-927d-63088b5cfb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:56.270642 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 559/1112] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:56.299412 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191434ee-78ab-4855-b958-1ced2479214a None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:56.399965 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191434ee-78ab-4855-b958-1ced2479214a None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:56.432798 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b9759-e55b-4580-b0c1-f5e67830a569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:56.433577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b9759-e55b-4580-b0c1-f5e67830a569 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:56.433847 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b9759-e55b-4580-b0c1-f5e67830a569 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:56.434139 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b9759-e55b-4580-b0c1-f5e67830a569 None admin] PATH_INFO: `/v3/roles/cb8032f764644c90a3dc0cb396434d67` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:56.435623 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b9759-e55b-4580-b0c1-f5e67830a569 None admin] RBAC: Authorizing `identity:get_role(role_id=cb8032f764644c90a3dc0cb396434d67)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:56.436977 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b9759-e55b-4580-b0c1-f5e67830a569 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:56.438391 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 554/1113] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:48:56 2022] GET /identity/v3/roles/cb8032f764644c90a3dc0cb396434d67 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:56.445590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcc9fc-7fe8-4acd-927d-63088b5cfb41 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:56.557065 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcc9fc-7fe8-4acd-927d-63088b5cfb41 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:56.590350 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde5bb7-47a8-47de-b94f-6ae39191d00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:56.591206 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5bb7-47a8-47de-b94f-6ae39191d00d None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:56.591481 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5bb7-47a8-47de-b94f-6ae39191d00d None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:56.591751 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5bb7-47a8-47de-b94f-6ae39191d00d None admin] PATH_INFO: `/v3/users/f4c447d2848c46d18c2b8f0684b9523e` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:56.604732 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde5bb7-47a8-47de-b94f-6ae39191d00d None admin] RBAC: Authorizing `identity:get_user(user_id=f4c447d2848c46d18c2b8f0684b9523e)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:56.606193 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde5bb7-47a8-47de-b94f-6ae39191d00d None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:56.607798 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 560/1114] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:48:56 2022] GET /identity/v3/users/f4c447d2848c46d18c2b8f0684b9523e => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:56.616914 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b9759-e55b-4580-b0c1-f5e67830a569 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:56.719759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b9759-e55b-4580-b0c1-f5e67830a569 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:56.759875 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e14f13-0351-4978-834e-52a9d8810312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:56.760791 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e14f13-0351-4978-834e-52a9d8810312 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:56.761150 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e14f13-0351-4978-834e-52a9d8810312 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:56.761511 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e14f13-0351-4978-834e-52a9d8810312 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:56.832617 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e14f13-0351-4978-834e-52a9d8810312 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:56.834076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e14f13-0351-4978-834e-52a9d8810312 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:56.929581 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 555/1115] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:48:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:48:56.938399 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde5bb7-47a8-47de-b94f-6ae39191d00d None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:57.039160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde5bb7-47a8-47de-b94f-6ae39191d00d None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:57.077274 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83952b7-7cdb-4d99-b54b-585f6dabb412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:57.078148 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83952b7-7cdb-4d99-b54b-585f6dabb412 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:57.078422 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83952b7-7cdb-4d99-b54b-585f6dabb412 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:57.078685 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83952b7-7cdb-4d99-b54b-585f6dabb412 None admin] PATH_INFO: `/v3/projects/8d657344e54d4ee19495ae997bd6ec37` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:57.079917 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83952b7-7cdb-4d99-b54b-585f6dabb412 None admin] RBAC: Authorizing `identity:get_project(project_id=8d657344e54d4ee19495ae997bd6ec37)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:57.081330 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83952b7-7cdb-4d99-b54b-585f6dabb412 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:57.083040 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 561/1116] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:48:56 2022] GET /identity/v3/projects/8d657344e54d4ee19495ae997bd6ec37 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:57.090109 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e14f13-0351-4978-834e-52a9d8810312 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:57.198527 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e14f13-0351-4978-834e-52a9d8810312 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:57.235098 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84b75a-161f-4a4c-856c-7e34a6e5a1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:57.235732 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84b75a-161f-4a4c-856c-7e34a6e5a1c8 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:57.236005 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84b75a-161f-4a4c-856c-7e34a6e5a1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:57.236267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84b75a-161f-4a4c-856c-7e34a6e5a1c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:57.237089 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84b75a-161f-4a4c-856c-7e34a6e5a1c8 None admin] RBAC: Adding query filter params (role.id=cb8032f764644c90a3dc0cb396434d67, scope.project.id=8d657344e54d4ee19495ae997bd6ec37, user.id=f4c447d2848c46d18c2b8f0684b9523e) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:48:57.237387 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84b75a-161f-4a4c-856c-7e34a6e5a1c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:57.238829 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84b75a-161f-4a4c-856c-7e34a6e5a1c8 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:57.244291 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 556/1117] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:48:57 2022] GET /identity/v3/role_assignments?user.id=f4c447d2848c46d18c2b8f0684b9523e&scope.project.id=8d657344e54d4ee19495ae997bd6ec37&role.id=cb8032f764644c90a3dc0cb396434d67 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:59.435394 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ae5fd-0596-41e0-9e3b-7715baa761cb None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:59.436265 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ae5fd-0596-41e0-9e3b-7715baa761cb None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:59.436265 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ae5fd-0596-41e0-9e3b-7715baa761cb None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:59.438500 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 562/1118] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:48:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:48:59.444095 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9f364-c00f-4a94-9fbb-6f449d6f00e6 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:59.444514 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9f364-c00f-4a94-9fbb-6f449d6f00e6 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:59.444868 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9f364-c00f-4a94-9fbb-6f449d6f00e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:59.463259 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-61a9f364-c00f-4a94-9fbb-6f449d6f00e6 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:48:59.464407 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-61a9f364-c00f-4a94-9fbb-6f449d6f00e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:48:59.532387 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 557/1119] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:48:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:48:59.556789 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ae5fd-0596-41e0-9e3b-7715baa761cb None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:59.667367 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ae5fd-0596-41e0-9e3b-7715baa761cb None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:59.700386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5fdbc-cba2-4c33-8bcf-2f8c8fd3e6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:59.701219 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5fdbc-cba2-4c33-8bcf-2f8c8fd3e6cc None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:59.701487 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5fdbc-cba2-4c33-8bcf-2f8c8fd3e6cc None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:59.701756 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5fdbc-cba2-4c33-8bcf-2f8c8fd3e6cc None admin] PATH_INFO: `/v3/roles/cb8032f764644c90a3dc0cb396434d67` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:59.703258 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5fdbc-cba2-4c33-8bcf-2f8c8fd3e6cc None admin] RBAC: Authorizing `identity:get_role(role_id=cb8032f764644c90a3dc0cb396434d67)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:59.704611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5fdbc-cba2-4c33-8bcf-2f8c8fd3e6cc None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:59.705974 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 563/1120] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:48:59 2022] GET /identity/v3/roles/cb8032f764644c90a3dc0cb396434d67 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:59.713899 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9f364-c00f-4a94-9fbb-6f449d6f00e6 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:59.822197 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9f364-c00f-4a94-9fbb-6f449d6f00e6 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:48:59.855390 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6d5d-90dd-40fa-a39f-9dc6d4875c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:48:59.856258 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6d5d-90dd-40fa-a39f-9dc6d4875c5f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:48:59.856531 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6d5d-90dd-40fa-a39f-9dc6d4875c5f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:48:59.856795 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6d5d-90dd-40fa-a39f-9dc6d4875c5f None admin] PATH_INFO: `/v3/users/f4c447d2848c46d18c2b8f0684b9523e` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:48:59.858008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee6d5d-90dd-40fa-a39f-9dc6d4875c5f None admin] RBAC: Authorizing `identity:get_user(user_id=f4c447d2848c46d18c2b8f0684b9523e)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:48:59.859434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee6d5d-90dd-40fa-a39f-9dc6d4875c5f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:48:59.861078 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 558/1121] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:48:59 2022] GET /identity/v3/users/f4c447d2848c46d18c2b8f0684b9523e => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:48:59.868132 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5fdbc-cba2-4c33-8bcf-2f8c8fd3e6cc None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:48:59.976800 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5fdbc-cba2-4c33-8bcf-2f8c8fd3e6cc None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:00.011517 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71945f5-e92b-4525-b18f-4b595504f5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:00.012359 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71945f5-e92b-4525-b18f-4b595504f5ec None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:00.012599 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71945f5-e92b-4525-b18f-4b595504f5ec None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:00.012886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71945f5-e92b-4525-b18f-4b595504f5ec None admin] PATH_INFO: `/v3/projects/8d657344e54d4ee19495ae997bd6ec37` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:00.014226 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71945f5-e92b-4525-b18f-4b595504f5ec None admin] RBAC: Authorizing `identity:get_project(project_id=8d657344e54d4ee19495ae997bd6ec37)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:00.015648 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71945f5-e92b-4525-b18f-4b595504f5ec None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:00.017308 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 564/1122] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:48:59 2022] GET /identity/v3/projects/8d657344e54d4ee19495ae997bd6ec37 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:00.024461 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6d5d-90dd-40fa-a39f-9dc6d4875c5f None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:00.127487 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6d5d-90dd-40fa-a39f-9dc6d4875c5f None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:00.160805 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc4e61-2101-4b5a-b8e2-f65d603ad7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:00.161679 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc4e61-2101-4b5a-b8e2-f65d603ad7c9 None admin] REQUEST_METHOD: `PUT` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:00.161978 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc4e61-2101-4b5a-b8e2-f65d603ad7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:00.162244 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc4e61-2101-4b5a-b8e2-f65d603ad7c9 None admin] PATH_INFO: `/v3/projects/8d657344e54d4ee19495ae997bd6ec37/users/f4c447d2848c46d18c2b8f0684b9523e/roles/cb8032f764644c90a3dc0cb396434d67` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:00.164884 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc4e61-2101-4b5a-b8e2-f65d603ad7c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d657344e54d4ee19495ae997bd6ec37, user_id=f4c447d2848c46d18c2b8f0684b9523e, role_id=cb8032f764644c90a3dc0cb396434d67)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:00.166335 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc4e61-2101-4b5a-b8e2-f65d603ad7c9 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:00.183097 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 559/1123] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:49:00 2022] PUT /identity/v3/projects/8d657344e54d4ee19495ae997bd6ec37/users/f4c447d2848c46d18c2b8f0684b9523e/roles/cb8032f764644c90a3dc0cb396434d67 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:49:02.367176 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ed0ff-8162-4e68-af7e-3368a8a5fc9d None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:02.367701 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ed0ff-8162-4e68-af7e-3368a8a5fc9d None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:02.367701 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ed0ff-8162-4e68-af7e-3368a8a5fc9d None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:02.369075 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 565/1124] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:49:02.375358 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d91c7b-dc1f-451f-abd7-f192d7e070db None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:02.375794 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d91c7b-dc1f-451f-abd7-f192d7e070db None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:02.375921 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d91c7b-dc1f-451f-abd7-f192d7e070db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:02.396003 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-a8d91c7b-dc1f-451f-abd7-f192d7e070db None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:49:02.397169 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-a8d91c7b-dc1f-451f-abd7-f192d7e070db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:49:02.471605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 560/1125] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:49:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:49:02.500313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ed0ff-8162-4e68-af7e-3368a8a5fc9d None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:02.610614 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ed0ff-8162-4e68-af7e-3368a8a5fc9d None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:02.644704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387ad5b-cd65-427d-bb12-6f35d89aa361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:02.645540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387ad5b-cd65-427d-bb12-6f35d89aa361 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:02.645837 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387ad5b-cd65-427d-bb12-6f35d89aa361 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:02.646103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387ad5b-cd65-427d-bb12-6f35d89aa361 None admin] PATH_INFO: `/v3/roles/cb8032f764644c90a3dc0cb396434d67` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:02.647683 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387ad5b-cd65-427d-bb12-6f35d89aa361 None admin] RBAC: Authorizing `identity:get_role(role_id=cb8032f764644c90a3dc0cb396434d67)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:02.649159 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387ad5b-cd65-427d-bb12-6f35d89aa361 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:02.650568 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 566/1126] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:49:02 2022] GET /identity/v3/roles/cb8032f764644c90a3dc0cb396434d67 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:02.657190 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d91c7b-dc1f-451f-abd7-f192d7e070db None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:02.772850 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d91c7b-dc1f-451f-abd7-f192d7e070db None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:02.810073 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60be34c-a28b-482b-b93a-39fb58b60095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:02.810944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60be34c-a28b-482b-b93a-39fb58b60095 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:02.811222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60be34c-a28b-482b-b93a-39fb58b60095 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:02.811494 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60be34c-a28b-482b-b93a-39fb58b60095 None admin] PATH_INFO: `/v3/users/f4c447d2848c46d18c2b8f0684b9523e` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:02.812710 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60be34c-a28b-482b-b93a-39fb58b60095 None admin] RBAC: Authorizing `identity:get_user(user_id=f4c447d2848c46d18c2b8f0684b9523e)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:02.814174 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60be34c-a28b-482b-b93a-39fb58b60095 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:02.815805 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 561/1127] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:49:02 2022] GET /identity/v3/users/f4c447d2848c46d18c2b8f0684b9523e => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:02.821847 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387ad5b-cd65-427d-bb12-6f35d89aa361 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:02.922931 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387ad5b-cd65-427d-bb12-6f35d89aa361 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:02.956538 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3c657-3e91-4cdb-a916-0bcc03f50265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:02.957167 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3c657-3e91-4cdb-a916-0bcc03f50265 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:02.957444 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3c657-3e91-4cdb-a916-0bcc03f50265 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:02.957714 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3c657-3e91-4cdb-a916-0bcc03f50265 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:03.022523 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3c657-3e91-4cdb-a916-0bcc03f50265 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:03.023966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3c657-3e91-4cdb-a916-0bcc03f50265 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:03.118718 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 567/1128] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:49:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:49:03.124780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60be34c-a28b-482b-b93a-39fb58b60095 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:03.229096 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60be34c-a28b-482b-b93a-39fb58b60095 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:03.263572 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065391f-fe51-4b92-b10f-561c3a2ccf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:03.264428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065391f-fe51-4b92-b10f-561c3a2ccf37 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:03.264703 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065391f-fe51-4b92-b10f-561c3a2ccf37 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:03.264975 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065391f-fe51-4b92-b10f-561c3a2ccf37 None admin] PATH_INFO: `/v3/projects/8d657344e54d4ee19495ae997bd6ec37` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:03.266289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065391f-fe51-4b92-b10f-561c3a2ccf37 None admin] RBAC: Authorizing `identity:get_project(project_id=8d657344e54d4ee19495ae997bd6ec37)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:03.267701 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065391f-fe51-4b92-b10f-561c3a2ccf37 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:03.269396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 562/1129] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:49:03 2022] GET /identity/v3/projects/8d657344e54d4ee19495ae997bd6ec37 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:03.275866 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3c657-3e91-4cdb-a916-0bcc03f50265 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:03.375845 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3c657-3e91-4cdb-a916-0bcc03f50265 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:03.409929 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908d539-84f5-467e-8f8c-ee1c41e15f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:03.410570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908d539-84f5-467e-8f8c-ee1c41e15f96 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:03.410824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908d539-84f5-467e-8f8c-ee1c41e15f96 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:03.411112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908d539-84f5-467e-8f8c-ee1c41e15f96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:03.411934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908d539-84f5-467e-8f8c-ee1c41e15f96 None admin] RBAC: Adding query filter params (role.id=cb8032f764644c90a3dc0cb396434d67, scope.project.id=8d657344e54d4ee19495ae997bd6ec37, user.id=f4c447d2848c46d18c2b8f0684b9523e) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:49:03.412244 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908d539-84f5-467e-8f8c-ee1c41e15f96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:03.413689 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908d539-84f5-467e-8f8c-ee1c41e15f96 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:03.419404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 568/1130] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:49:03 2022] GET /identity/v3/role_assignments?user.id=f4c447d2848c46d18c2b8f0684b9523e&scope.project.id=8d657344e54d4ee19495ae997bd6ec37&role.id=cb8032f764644c90a3dc0cb396434d67 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:05.641682 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162fea5-c23b-47a9-a152-a3a04fe4570b None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:05.642526 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162fea5-c23b-47a9-a152-a3a04fe4570b None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:05.642526 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162fea5-c23b-47a9-a152-a3a04fe4570b None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:05.644647 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 563/1131] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:49:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:49:05.652572 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77462385-d029-4988-8b79-d4626bd019ae None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:05.653007 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77462385-d029-4988-8b79-d4626bd019ae None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:05.653096 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77462385-d029-4988-8b79-d4626bd019ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:05.671267 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-77462385-d029-4988-8b79-d4626bd019ae None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:49:05.672425 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-77462385-d029-4988-8b79-d4626bd019ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:49:05.737688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 569/1132] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:49:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:49:05.761740 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162fea5-c23b-47a9-a152-a3a04fe4570b None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:05.881949 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162fea5-c23b-47a9-a152-a3a04fe4570b None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:05.915425 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728763f-0abf-467a-97ab-c5425af67d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:05.916136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728763f-0abf-467a-97ab-c5425af67d61 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:05.916409 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728763f-0abf-467a-97ab-c5425af67d61 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:05.916677 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728763f-0abf-467a-97ab-c5425af67d61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:05.917879 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728763f-0abf-467a-97ab-c5425af67d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:05.919296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728763f-0abf-467a-97ab-c5425af67d61 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:05.920888 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 564/1133] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:49:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:05.927123 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77462385-d029-4988-8b79-d4626bd019ae None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:06.022314 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77462385-d029-4988-8b79-d4626bd019ae None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:06.058613 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a4e84-a5a9-4dd9-8500-6bc9c11374ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:06.059249 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a4e84-a5a9-4dd9-8500-6bc9c11374ae None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:06.059522 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a4e84-a5a9-4dd9-8500-6bc9c11374ae None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:06.059789 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a4e84-a5a9-4dd9-8500-6bc9c11374ae None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:06.060496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a4e84-a5a9-4dd9-8500-6bc9c11374ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:06.061929 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a4e84-a5a9-4dd9-8500-6bc9c11374ae None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:06.090851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 570/1134] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 3 09:49:05 2022] POST /identity/v3/projects => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:49:08.317985 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802f067-7511-4352-ada9-2ac22ff5fe38 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:08.318438 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802f067-7511-4352-ada9-2ac22ff5fe38 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:08.318551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802f067-7511-4352-ada9-2ac22ff5fe38 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:08.319960 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 565/1135] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:49:08.326371 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af21090-037d-4989-b81c-2fae71e251b0 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:08.327097 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af21090-037d-4989-b81c-2fae71e251b0 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:08.327245 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af21090-037d-4989-b81c-2fae71e251b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:08.352803 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-8af21090-037d-4989-b81c-2fae71e251b0 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:49:08.354001 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-8af21090-037d-4989-b81c-2fae71e251b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:49:08.433402 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 571/1136] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:49:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:49:08.458350 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802f067-7511-4352-ada9-2ac22ff5fe38 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:08.562010 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802f067-7511-4352-ada9-2ac22ff5fe38 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:08.603552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffb741-47ad-45a4-9645-9b0f493edba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:08.604345 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb741-47ad-45a4-9645-9b0f493edba0 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:08.604626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb741-47ad-45a4-9645-9b0f493edba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:08.604898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb741-47ad-45a4-9645-9b0f493edba0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:08.606159 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffb741-47ad-45a4-9645-9b0f493edba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:08.607571 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffb741-47ad-45a4-9645-9b0f493edba0 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:08.609212 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 566/1137] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:49:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:08.615331 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af21090-037d-4989-b81c-2fae71e251b0 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:08.727046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af21090-037d-4989-b81c-2fae71e251b0 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:08.773822 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c90c9-d555-456a-85e3-7ee00ed2f34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:08.774475 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c90c9-d555-456a-85e3-7ee00ed2f34c None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:08.774758 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c90c9-d555-456a-85e3-7ee00ed2f34c None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:08.775046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c90c9-d555-456a-85e3-7ee00ed2f34c None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:08.775757 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c90c9-d555-456a-85e3-7ee00ed2f34c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:08.777181 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c90c9-d555-456a-85e3-7ee00ed2f34c None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:08.802097 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 572/1138] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:49:08 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:49:11.053063 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feac2d-f326-4454-8b20-19fa94b9683f None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:11.053922 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feac2d-f326-4454-8b20-19fa94b9683f None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:11.054327 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feac2d-f326-4454-8b20-19fa94b9683f None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:11.056454 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 567/1139] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:49:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:49:11.064293 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8336c88-8a7f-4c65-b5a5-e061b880906d None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:11.064752 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8336c88-8a7f-4c65-b5a5-e061b880906d None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:11.064853 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8336c88-8a7f-4c65-b5a5-e061b880906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:11.083182 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-c8336c88-8a7f-4c65-b5a5-e061b880906d None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:49:11.084344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-c8336c88-8a7f-4c65-b5a5-e061b880906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:49:11.155794 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 573/1140] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:49:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:49:11.179591 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81feac2d-f326-4454-8b20-19fa94b9683f None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:11.306344 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81feac2d-f326-4454-8b20-19fa94b9683f None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:11.343845 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213e9b1-be6c-46e5-9106-0a86789bc3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:11.344626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213e9b1-be6c-46e5-9106-0a86789bc3dc None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:11.344904 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213e9b1-be6c-46e5-9106-0a86789bc3dc None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:11.345156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213e9b1-be6c-46e5-9106-0a86789bc3dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:11.355696 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213e9b1-be6c-46e5-9106-0a86789bc3dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:49:11.363263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-5213e9b1-be6c-46e5-9106-0a86789bc3dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:49:11.363263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:49:11.363263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:49:11.363263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:49:11.363263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:49:11.363263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:49:11.363263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:49:11.363263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:49:11.363263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:49:11.363263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:49:11.363263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:49:11.363263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:49:11.363263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:49:11.363263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:49:11.363263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:49:11.363263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:49:11.364465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:49:11.364465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:49:11.364465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:49:11.364465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:49:11.364465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:49:11.364465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:49:11.364465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:49:11.364465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:49:11.364465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:49:11.364465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:49:11.364465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:49:11.364465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:49:11.364465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:49:11.364465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:49:11.364465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:49:11.364465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:49:11.365363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:49:11.365363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:49:11.365363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:49:11.365363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:49:11.365363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:49:11.365363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:49:11.365363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:49:11.365363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:49:11.365363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:49:11.365363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:49:11.365363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:49:11.365363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:49:11.365363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 568/1141] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:49:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:49:11.371410 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8336c88-8a7f-4c65-b5a5-e061b880906d None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:11.478232 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8336c88-8a7f-4c65-b5a5-e061b880906d None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:11.514581 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372982b-8d33-4b1e-8bb1-59dd6f8bf0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:11.515235 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372982b-8d33-4b1e-8bb1-59dd6f8bf0a3 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:11.515511 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372982b-8d33-4b1e-8bb1-59dd6f8bf0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:11.515782 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372982b-8d33-4b1e-8bb1-59dd6f8bf0a3 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:11.516516 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372982b-8d33-4b1e-8bb1-59dd6f8bf0a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:49:11.516810 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372982b-8d33-4b1e-8bb1-59dd6f8bf0a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:11.518198 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372982b-8d33-4b1e-8bb1-59dd6f8bf0a3 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:11.526673 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 574/1142] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:49:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:11.536354 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213e9b1-be6c-46e5-9106-0a86789bc3dc None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:11.643959 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213e9b1-be6c-46e5-9106-0a86789bc3dc None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:11.677148 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3cf876-5f02-4e0a-824f-61f49a7b2c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:11.678023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cf876-5f02-4e0a-824f-61f49a7b2c4d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:11.678296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cf876-5f02-4e0a-824f-61f49a7b2c4d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:11.678570 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cf876-5f02-4e0a-824f-61f49a7b2c4d None admin] PATH_INFO: `/v3/users/bf897dcce5934094ade2720bfb07fa40` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:11.692627 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3cf876-5f02-4e0a-824f-61f49a7b2c4d None admin] RBAC: Authorizing `identity:get_user(user_id=bf897dcce5934094ade2720bfb07fa40)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:11.694088 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3cf876-5f02-4e0a-824f-61f49a7b2c4d None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:11.695743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 569/1143] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:49:11 2022] GET /identity/v3/users/bf897dcce5934094ade2720bfb07fa40 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:11.701724 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372982b-8d33-4b1e-8bb1-59dd6f8bf0a3 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:11.799356 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372982b-8d33-4b1e-8bb1-59dd6f8bf0a3 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:11.832642 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60531e-ab15-4c94-856b-070e54ed3c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:11.833272 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60531e-ab15-4c94-856b-070e54ed3c6b None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:11.833551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60531e-ab15-4c94-856b-070e54ed3c6b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:11.833840 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60531e-ab15-4c94-856b-070e54ed3c6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:11.901948 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60531e-ab15-4c94-856b-070e54ed3c6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:11.903315 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60531e-ab15-4c94-856b-070e54ed3c6b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:12.002137 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 575/1144] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:49:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:49:12.008984 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3cf876-5f02-4e0a-824f-61f49a7b2c4d None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:12.121486 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3cf876-5f02-4e0a-824f-61f49a7b2c4d None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:12.155250 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfff745-16d4-4afd-863c-1293e564edd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:12.156032 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfff745-16d4-4afd-863c-1293e564edd4 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:12.156305 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfff745-16d4-4afd-863c-1293e564edd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:12.156577 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfff745-16d4-4afd-863c-1293e564edd4 None admin] PATH_INFO: `/v3/projects/36eaec5b8bae4109942f50848e485f6f` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:12.157742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfff745-16d4-4afd-863c-1293e564edd4 None admin] RBAC: Authorizing `identity:get_project(project_id=36eaec5b8bae4109942f50848e485f6f)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:12.159193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfff745-16d4-4afd-863c-1293e564edd4 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:12.160846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 570/1145] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:49:12 2022] GET /identity/v3/projects/36eaec5b8bae4109942f50848e485f6f => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:12.170551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60531e-ab15-4c94-856b-070e54ed3c6b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:12.289829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60531e-ab15-4c94-856b-070e54ed3c6b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:12.326827 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a11f67-3206-45f7-9ab8-08a7ea6b362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:12.327467 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a11f67-3206-45f7-9ab8-08a7ea6b362e None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:12.327743 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a11f67-3206-45f7-9ab8-08a7ea6b362e None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:12.328012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a11f67-3206-45f7-9ab8-08a7ea6b362e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:12.328809 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a11f67-3206-45f7-9ab8-08a7ea6b362e None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=36eaec5b8bae4109942f50848e485f6f, user.id=bf897dcce5934094ade2720bfb07fa40) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:49:12.329113 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a11f67-3206-45f7-9ab8-08a7ea6b362e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:12.330549 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a11f67-3206-45f7-9ab8-08a7ea6b362e None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:12.336078 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 576/1146] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:49:12 2022] GET /identity/v3/role_assignments?user.id=bf897dcce5934094ade2720bfb07fa40&scope.project.id=36eaec5b8bae4109942f50848e485f6f&role.id=52d3ad3e32c741938997691c9a909b81 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:14.517042 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e74d16-602f-49b2-a217-7ac7ba46b1bc None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:14.517583 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e74d16-602f-49b2-a217-7ac7ba46b1bc None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:14.517583 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e74d16-602f-49b2-a217-7ac7ba46b1bc None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:14.519706 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 571/1147] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:49:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:49:14.527354 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a2a8a-6b73-4d01-84a9-b6b7946f7048 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:14.527771 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a2a8a-6b73-4d01-84a9-b6b7946f7048 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:14.527921 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a2a8a-6b73-4d01-84a9-b6b7946f7048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:14.554746 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-896a2a8a-6b73-4d01-84a9-b6b7946f7048 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:49:14.555852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-896a2a8a-6b73-4d01-84a9-b6b7946f7048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:49:14.621267 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 577/1148] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:49:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:49:14.654656 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e74d16-602f-49b2-a217-7ac7ba46b1bc None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:14.764014 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e74d16-602f-49b2-a217-7ac7ba46b1bc None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:14.817894 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a5e3b-355a-46e8-9aaa-96655128178c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:14.818954 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a5e3b-355a-46e8-9aaa-96655128178c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:14.819331 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a5e3b-355a-46e8-9aaa-96655128178c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:14.819693 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a5e3b-355a-46e8-9aaa-96655128178c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:14.836849 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a5e3b-355a-46e8-9aaa-96655128178c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:49:14.844396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-258a5e3b-355a-46e8-9aaa-96655128178c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:49:14.844396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:49:14.844396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:49:14.844396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:49:14.844396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:49:14.844396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:49:14.844396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:49:14.844396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:49:14.844396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:49:14.844396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:49:14.844396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:49:14.844396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:49:14.844396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:49:14.844396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:49:14.844396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:49:14.844396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:49:14.845372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:49:14.845372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:49:14.845372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:49:14.845372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:49:14.845372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:49:14.845372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:49:14.845372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:49:14.845372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:49:14.845372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:49:14.845372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:49:14.845372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:49:14.845372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:49:14.845372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:49:14.845372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:49:14.845372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:49:14.845372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:49:14.846348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:49:14.846348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:49:14.846348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:49:14.846348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:49:14.846348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:49:14.846348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:49:14.846348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:49:14.846348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:49:14.846348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:49:14.846348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:49:14.846348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:49:14.846348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:49:14.846348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 572/1149] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:49:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:49:14.851968 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a2a8a-6b73-4d01-84a9-b6b7946f7048 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:14.971958 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a2a8a-6b73-4d01-84a9-b6b7946f7048 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:15.013321 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212c4f8-6efe-405a-9716-e2042dd94fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:15.014003 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212c4f8-6efe-405a-9716-e2042dd94fda None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:15.014279 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212c4f8-6efe-405a-9716-e2042dd94fda None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:15.014547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212c4f8-6efe-405a-9716-e2042dd94fda None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:15.015281 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212c4f8-6efe-405a-9716-e2042dd94fda None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:49:15.015576 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212c4f8-6efe-405a-9716-e2042dd94fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:15.016940 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212c4f8-6efe-405a-9716-e2042dd94fda None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:15.024840 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 578/1150] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:49:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:15.033846 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a5e3b-355a-46e8-9aaa-96655128178c None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:15.134424 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a5e3b-355a-46e8-9aaa-96655128178c None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:15.171111 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa6375-50db-49c9-82e2-eedde02eac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:15.171959 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa6375-50db-49c9-82e2-eedde02eac6e None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:15.172236 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa6375-50db-49c9-82e2-eedde02eac6e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:15.172508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa6375-50db-49c9-82e2-eedde02eac6e None admin] PATH_INFO: `/v3/users/bf897dcce5934094ade2720bfb07fa40` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:15.173697 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa6375-50db-49c9-82e2-eedde02eac6e None admin] RBAC: Authorizing `identity:get_user(user_id=bf897dcce5934094ade2720bfb07fa40)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:15.175171 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa6375-50db-49c9-82e2-eedde02eac6e None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:15.176780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 573/1151] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:49:15 2022] GET /identity/v3/users/bf897dcce5934094ade2720bfb07fa40 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:49:15.183762 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212c4f8-6efe-405a-9716-e2042dd94fda None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:15.303760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212c4f8-6efe-405a-9716-e2042dd94fda None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:15.337024 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02076ef1-88b2-4526-b603-21afe9e96be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:15.337911 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02076ef1-88b2-4526-b603-21afe9e96be0 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:15.338185 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02076ef1-88b2-4526-b603-21afe9e96be0 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:15.338452 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02076ef1-88b2-4526-b603-21afe9e96be0 None admin] PATH_INFO: `/v3/projects/36eaec5b8bae4109942f50848e485f6f` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:15.339731 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02076ef1-88b2-4526-b603-21afe9e96be0 None admin] RBAC: Authorizing `identity:get_project(project_id=36eaec5b8bae4109942f50848e485f6f)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:15.341186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02076ef1-88b2-4526-b603-21afe9e96be0 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:15.342922 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 579/1152] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:49:15 2022] GET /identity/v3/projects/36eaec5b8bae4109942f50848e485f6f => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:15.349253 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa6375-50db-49c9-82e2-eedde02eac6e None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:15.451587 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa6375-50db-49c9-82e2-eedde02eac6e None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:15.484660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c84ad2-4ca6-4d99-be01-bf0017f1b766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:15.485535 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c84ad2-4ca6-4d99-be01-bf0017f1b766 None admin] REQUEST_METHOD: `PUT` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:15.485837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c84ad2-4ca6-4d99-be01-bf0017f1b766 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:15.486114 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c84ad2-4ca6-4d99-be01-bf0017f1b766 None admin] PATH_INFO: `/v3/projects/36eaec5b8bae4109942f50848e485f6f/users/bf897dcce5934094ade2720bfb07fa40/roles/52d3ad3e32c741938997691c9a909b81` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:15.488141 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c84ad2-4ca6-4d99-be01-bf0017f1b766 None admin] RBAC: Authorizing `identity:create_grant(project_id=36eaec5b8bae4109942f50848e485f6f, user_id=bf897dcce5934094ade2720bfb07fa40, role_id=52d3ad3e32c741938997691c9a909b81)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:15.489564 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c84ad2-4ca6-4d99-be01-bf0017f1b766 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:15.508223 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 574/1153] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:49:15 2022] PUT /identity/v3/projects/36eaec5b8bae4109942f50848e485f6f/users/bf897dcce5934094ade2720bfb07fa40/roles/52d3ad3e32c741938997691c9a909b81 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:49:17.697529 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf313d-6d62-43ef-9e98-bf296e57a831 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:17.698409 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf313d-6d62-43ef-9e98-bf296e57a831 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:17.698409 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf313d-6d62-43ef-9e98-bf296e57a831 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:17.700538 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 580/1154] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:49:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:49:17.705785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2845a0b-c34d-4190-a632-73c64d119280 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:17.706225 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2845a0b-c34d-4190-a632-73c64d119280 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:17.706399 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2845a0b-c34d-4190-a632-73c64d119280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:17.724626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-b2845a0b-c34d-4190-a632-73c64d119280 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:49:17.725822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-b2845a0b-c34d-4190-a632-73c64d119280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:49:17.801230 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 575/1155] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:49:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:49:17.825326 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf313d-6d62-43ef-9e98-bf296e57a831 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:17.951898 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf313d-6d62-43ef-9e98-bf296e57a831 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:17.987790 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d01272-769d-41b5-9a6d-676155035500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:17.988566 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d01272-769d-41b5-9a6d-676155035500 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:17.988827 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d01272-769d-41b5-9a6d-676155035500 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:17.989098 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d01272-769d-41b5-9a6d-676155035500 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:18.001551 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d01272-769d-41b5-9a6d-676155035500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:49:18.009291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-49d01272-769d-41b5-9a6d-676155035500 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:49:18.009291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:49:18.009291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:49:18.009291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:49:18.009291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:49:18.009291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:49:18.009291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:49:18.009291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:49:18.009291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:49:18.009291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:49:18.009291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:49:18.009291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:49:18.009291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:49:18.009291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:49:18.009291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:49:18.009291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:49:18.010730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:49:18.010730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:49:18.010730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:49:18.010730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:49:18.010730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:49:18.010730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:49:18.010730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:49:18.010730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:49:18.010730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:49:18.010730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:49:18.010730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:49:18.010730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:49:18.010730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:49:18.010730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:49:18.010730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:49:18.010730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:49:18.011869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:49:18.011869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:49:18.011869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:49:18.011869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:49:18.011869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:49:18.011869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:49:18.011869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:49:18.011869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:49:18.011869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:49:18.011869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:49:18.011869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:49:18.011869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:49:18.011869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 581/1156] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:49:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:49:18.017071 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2845a0b-c34d-4190-a632-73c64d119280 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:18.121261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2845a0b-c34d-4190-a632-73c64d119280 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:18.161260 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50cb5f-3ea5-44c2-b784-d4913c11f78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:18.161944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50cb5f-3ea5-44c2-b784-d4913c11f78e None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:18.162217 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50cb5f-3ea5-44c2-b784-d4913c11f78e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:18.162483 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50cb5f-3ea5-44c2-b784-d4913c11f78e None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:18.163209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50cb5f-3ea5-44c2-b784-d4913c11f78e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:49:18.163558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50cb5f-3ea5-44c2-b784-d4913c11f78e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:18.164925 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50cb5f-3ea5-44c2-b784-d4913c11f78e None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:18.173187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 576/1157] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:49:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:18.179658 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d01272-769d-41b5-9a6d-676155035500 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:18.287619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d01272-769d-41b5-9a6d-676155035500 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:18.326235 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3a974-c3ff-4f29-9256-a2429209b9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:18.327100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3a974-c3ff-4f29-9256-a2429209b9a2 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:18.327371 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3a974-c3ff-4f29-9256-a2429209b9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:18.327630 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3a974-c3ff-4f29-9256-a2429209b9a2 None admin] PATH_INFO: `/v3/users/bf897dcce5934094ade2720bfb07fa40` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:18.328859 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3a974-c3ff-4f29-9256-a2429209b9a2 None admin] RBAC: Authorizing `identity:get_user(user_id=bf897dcce5934094ade2720bfb07fa40)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:18.330302 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3a974-c3ff-4f29-9256-a2429209b9a2 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:18.331934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 582/1158] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:49:18 2022] GET /identity/v3/users/bf897dcce5934094ade2720bfb07fa40 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:18.342309 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50cb5f-3ea5-44c2-b784-d4913c11f78e None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:18.452774 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50cb5f-3ea5-44c2-b784-d4913c11f78e None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:18.491551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f30c4-bba9-4ad9-9dbe-c23438e2a2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:18.492245 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f30c4-bba9-4ad9-9dbe-c23438e2a2f2 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:18.492524 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f30c4-bba9-4ad9-9dbe-c23438e2a2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:18.492793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f30c4-bba9-4ad9-9dbe-c23438e2a2f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:18.558407 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f30c4-bba9-4ad9-9dbe-c23438e2a2f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:18.559785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f30c4-bba9-4ad9-9dbe-c23438e2a2f2 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:18.655757 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 577/1159] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:49:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:49:18.662237 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3a974-c3ff-4f29-9256-a2429209b9a2 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:18.763446 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3a974-c3ff-4f29-9256-a2429209b9a2 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:18.799141 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e8a15-2f51-4071-9333-f67beee3c3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:18.799981 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e8a15-2f51-4071-9333-f67beee3c3c4 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:18.800255 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e8a15-2f51-4071-9333-f67beee3c3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:18.800524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e8a15-2f51-4071-9333-f67beee3c3c4 None admin] PATH_INFO: `/v3/projects/36eaec5b8bae4109942f50848e485f6f` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:18.801837 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e8a15-2f51-4071-9333-f67beee3c3c4 None admin] RBAC: Authorizing `identity:get_project(project_id=36eaec5b8bae4109942f50848e485f6f)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:18.803253 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e8a15-2f51-4071-9333-f67beee3c3c4 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:18.805136 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 583/1160] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:49:18 2022] GET /identity/v3/projects/36eaec5b8bae4109942f50848e485f6f => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:18.812405 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f30c4-bba9-4ad9-9dbe-c23438e2a2f2 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:18.915241 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f30c4-bba9-4ad9-9dbe-c23438e2a2f2 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:18.951906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f1527-15f3-491c-9cef-0f79a73d735c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:18.952541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1527-15f3-491c-9cef-0f79a73d735c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:18.952812 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1527-15f3-491c-9cef-0f79a73d735c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:18.953075 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1527-15f3-491c-9cef-0f79a73d735c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:18.953926 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f1527-15f3-491c-9cef-0f79a73d735c None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=36eaec5b8bae4109942f50848e485f6f, user.id=bf897dcce5934094ade2720bfb07fa40) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:49:18.954231 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f1527-15f3-491c-9cef-0f79a73d735c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:18.955638 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f1527-15f3-491c-9cef-0f79a73d735c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:18.961953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 578/1161] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:49:18 2022] GET /identity/v3/role_assignments?user.id=bf897dcce5934094ade2720bfb07fa40&scope.project.id=36eaec5b8bae4109942f50848e485f6f&role.id=52d3ad3e32c741938997691c9a909b81 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:21.196220 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccacae-cdf9-4bfe-b2e3-03dacc9becbc None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:21.196778 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccacae-cdf9-4bfe-b2e3-03dacc9becbc None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:21.196778 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccacae-cdf9-4bfe-b2e3-03dacc9becbc None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:21.199073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 584/1162] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:49:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:49:21.206943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44136854-c17a-4be5-9705-830b36b532a7 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:21.207404 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44136854-c17a-4be5-9705-830b36b532a7 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:21.207495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44136854-c17a-4be5-9705-830b36b532a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:21.225668 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-44136854-c17a-4be5-9705-830b36b532a7 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:49:21.226904 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-44136854-c17a-4be5-9705-830b36b532a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:49:21.302388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 579/1163] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:49:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:49:21.325047 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccacae-cdf9-4bfe-b2e3-03dacc9becbc None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:21.448251 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccacae-cdf9-4bfe-b2e3-03dacc9becbc None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:21.487494 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc1d25-d7dc-4f7f-90b4-3ca2f5164fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:21.488141 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc1d25-d7dc-4f7f-90b4-3ca2f5164fd4 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:21.488423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc1d25-d7dc-4f7f-90b4-3ca2f5164fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:21.488702 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc1d25-d7dc-4f7f-90b4-3ca2f5164fd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:21.556620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc1d25-d7dc-4f7f-90b4-3ca2f5164fd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:21.558088 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc1d25-d7dc-4f7f-90b4-3ca2f5164fd4 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:21.653338 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 585/1164] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:49:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:49:21.663077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44136854-c17a-4be5-9705-830b36b532a7 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:21.763130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44136854-c17a-4be5-9705-830b36b532a7 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:21.796439 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b924d13-6d37-474d-85af-4dc5fada9afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:21.797222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b924d13-6d37-474d-85af-4dc5fada9afb None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:21.797467 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b924d13-6d37-474d-85af-4dc5fada9afb None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:21.797758 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b924d13-6d37-474d-85af-4dc5fada9afb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:21.804568 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b924d13-6d37-474d-85af-4dc5fada9afb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:21.806036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b924d13-6d37-474d-85af-4dc5fada9afb None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:21.820008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-1b924d13-6d37-474d-85af-4dc5fada9afb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 03 09:49:21.820008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:49:21.820008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 03 09:49:21.820008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 03 09:49:21.820008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:49:21.820008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:49:21.820008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:49:21.820008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:49:21.820008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 03 09:49:21.820008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:49:21.820008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:49:21.820008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:49:21.820008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:49:21.820008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:49:21.820008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:49:21.820008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:49:21.820008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:49:21.821157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:49:21.821157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:49:21.821157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:49:21.821157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:49:21.821157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:49:21.821157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:49:21.821157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:49:21.821157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:49:21.821157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:49:21.821157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:49:21.821157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:49:21.821157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:49:21.821157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:49:21.821157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:49:21.821157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:49:21.821157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:49:21.822099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:49:21.822099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:49:21.822099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:49:21.822099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:49:21.822099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:49:21.822099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:49:21.822099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:49:21.822099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:49:21.822099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:49:21.822099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:49:21.822099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 03 09:49:21.822099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:49:21.822099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 03 09:49:21.822099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:49:21.822099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 580/1165] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 3 09:49:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:49:21.828252 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc1d25-d7dc-4f7f-90b4-3ca2f5164fd4 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:21.933547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc1d25-d7dc-4f7f-90b4-3ca2f5164fd4 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:21.967128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b96a73-90b2-4621-841a-d289d54273ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:21.967773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b96a73-90b2-4621-841a-d289d54273ee None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:21.968050 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b96a73-90b2-4621-841a-d289d54273ee None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:21.968320 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b96a73-90b2-4621-841a-d289d54273ee None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:21.969033 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b96a73-90b2-4621-841a-d289d54273ee None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:49:21.969341 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b96a73-90b2-4621-841a-d289d54273ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:21.970717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b96a73-90b2-4621-841a-d289d54273ee None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:21.977821 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 586/1166] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 3 09:49:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:24.167022 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134774e-ec3a-4cf8-8551-d515c7ea78c0 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:24.167635 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134774e-ec3a-4cf8-8551-d515c7ea78c0 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:24.167635 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134774e-ec3a-4cf8-8551-d515c7ea78c0 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:24.168902 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 581/1167] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:49:24.174505 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ecce9-2747-4889-b00b-03e7108d9541 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:24.174935 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ecce9-2747-4889-b00b-03e7108d9541 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:24.175036 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ecce9-2747-4889-b00b-03e7108d9541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:24.192311 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-333ecce9-2747-4889-b00b-03e7108d9541 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:49:24.193487 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-333ecce9-2747-4889-b00b-03e7108d9541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:49:24.259487 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 587/1168] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:49:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:49:24.282887 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134774e-ec3a-4cf8-8551-d515c7ea78c0 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:24.385152 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134774e-ec3a-4cf8-8551-d515c7ea78c0 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:24.418267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d7886-c6d6-41f1-9aa2-b958563b80d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:24.418836 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7886-c6d6-41f1-9aa2-b958563b80d1 None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:24.419104 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7886-c6d6-41f1-9aa2-b958563b80d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:24.419370 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7886-c6d6-41f1-9aa2-b958563b80d1 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:24.420093 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d7886-c6d6-41f1-9aa2-b958563b80d1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:24.421440 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d7886-c6d6-41f1-9aa2-b958563b80d1 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:24.438660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 582/1169] 10.222.0.55 () {60 vars in 1138 bytes} [Tue May 3 09:49:24 2022] POST /identity/v3/domains => generated 267 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:49:26.726966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa7189-2928-4982-80e7-3d3283369dde None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:26.727790 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa7189-2928-4982-80e7-3d3283369dde None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:26.727790 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa7189-2928-4982-80e7-3d3283369dde None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:26.729703 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 588/1170] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:49:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:49:26.736022 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383151a-8e02-4f0f-abc4-61b7551712d0 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:26.736730 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383151a-8e02-4f0f-abc4-61b7551712d0 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:26.736885 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383151a-8e02-4f0f-abc4-61b7551712d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:26.757248 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-6383151a-8e02-4f0f-abc4-61b7551712d0 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:49:26.758442 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-6383151a-8e02-4f0f-abc4-61b7551712d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:49:26.825338 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 583/1171] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:49:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:49:26.852853 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa7189-2928-4982-80e7-3d3283369dde None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:26.960406 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa7189-2928-4982-80e7-3d3283369dde None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:26.994764 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99fc9b-647a-4522-8626-b7fd590a7581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:26.995554 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99fc9b-647a-4522-8626-b7fd590a7581 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:26.995830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99fc9b-647a-4522-8626-b7fd590a7581 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:26.996087 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99fc9b-647a-4522-8626-b7fd590a7581 None admin] PATH_INFO: `/v3/domains/7644a28fe3984755bd9b454482cf70b3` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:27.007735 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99fc9b-647a-4522-8626-b7fd590a7581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7644a28fe3984755bd9b454482cf70b3)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:27.009156 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99fc9b-647a-4522-8626-b7fd590a7581 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:27.011432 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 589/1172] 10.222.0.55 () {56 vars in 1183 bytes} [Tue May 3 09:49:26 2022] GET /identity/v3/domains/7644a28fe3984755bd9b454482cf70b3 => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:27.018132 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383151a-8e02-4f0f-abc4-61b7551712d0 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:27.123393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383151a-8e02-4f0f-abc4-61b7551712d0 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:27.156806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114775d-8e5a-4afa-9bb8-573dd9123d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:27.157446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114775d-8e5a-4afa-9bb8-573dd9123d5f None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:27.157713 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114775d-8e5a-4afa-9bb8-573dd9123d5f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:27.158010 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114775d-8e5a-4afa-9bb8-573dd9123d5f None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:27.158710 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114775d-8e5a-4afa-9bb8-573dd9123d5f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:27.160152 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114775d-8e5a-4afa-9bb8-573dd9123d5f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:27.194186 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 584/1173] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 3 09:49:27 2022] POST /identity/v3/projects => generated 361 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:49:29.460690 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690af587-d446-4ec5-a5f2-7fb0ff5f0271 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:29.461246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690af587-d446-4ec5-a5f2-7fb0ff5f0271 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:29.461359 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690af587-d446-4ec5-a5f2-7fb0ff5f0271 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:29.463558 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 590/1174] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:49:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:49:29.471432 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09658fa-894b-436d-864b-eda6d7e8f6e5 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:29.471898 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09658fa-894b-436d-864b-eda6d7e8f6e5 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:29.471991 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09658fa-894b-436d-864b-eda6d7e8f6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:29.489314 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-e09658fa-894b-436d-864b-eda6d7e8f6e5 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:49:29.490485 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-e09658fa-894b-436d-864b-eda6d7e8f6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:49:29.576493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 585/1175] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:49:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:49:29.603221 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690af587-d446-4ec5-a5f2-7fb0ff5f0271 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:29.721994 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690af587-d446-4ec5-a5f2-7fb0ff5f0271 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:29.760125 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ee28d-bcbb-496e-841d-809dbc8b7bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:29.760987 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ee28d-bcbb-496e-841d-809dbc8b7bfe None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:29.761256 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ee28d-bcbb-496e-841d-809dbc8b7bfe None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:29.761522 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ee28d-bcbb-496e-841d-809dbc8b7bfe None admin] PATH_INFO: `/v3/domains/7644a28fe3984755bd9b454482cf70b3` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:29.762740 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ee28d-bcbb-496e-841d-809dbc8b7bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=7644a28fe3984755bd9b454482cf70b3)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:29.764164 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ee28d-bcbb-496e-841d-809dbc8b7bfe None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:29.765777 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 591/1176] 10.222.0.55 () {56 vars in 1183 bytes} [Tue May 3 09:49:29 2022] GET /identity/v3/domains/7644a28fe3984755bd9b454482cf70b3 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:29.772740 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09658fa-894b-436d-864b-eda6d7e8f6e5 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:29.895910 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09658fa-894b-436d-864b-eda6d7e8f6e5 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:29.935262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08b49a-2754-465e-b3f3-91380edb10e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:29.935925 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08b49a-2754-465e-b3f3-91380edb10e1 None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:29.936204 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08b49a-2754-465e-b3f3-91380edb10e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:29.936470 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08b49a-2754-465e-b3f3-91380edb10e1 None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:29.937176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08b49a-2754-465e-b3f3-91380edb10e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:29.938624 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08b49a-2754-465e-b3f3-91380edb10e1 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:29.962833 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 586/1177] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:49:29 2022] POST /identity/v3/users => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:49:32.268427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34138bf-db6d-40f4-904d-811324ac1dab None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:32.268971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34138bf-db6d-40f4-904d-811324ac1dab None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:32.268971 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34138bf-db6d-40f4-904d-811324ac1dab None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:32.270383 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 592/1178] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:49:32.275768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfca5c-1322-466f-9bd4-828a8c96250c None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:32.276206 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfca5c-1322-466f-9bd4-828a8c96250c None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:32.276305 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfca5c-1322-466f-9bd4-828a8c96250c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:32.293997 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-5edfca5c-1322-466f-9bd4-828a8c96250c None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:49:32.295150 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-5edfca5c-1322-466f-9bd4-828a8c96250c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:49:32.362881 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 587/1179] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:49:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:49:32.386929 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34138bf-db6d-40f4-904d-811324ac1dab None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:32.499680 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34138bf-db6d-40f4-904d-811324ac1dab None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:32.536448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a23b3d-c16b-466c-80f2-aba10fbb0585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:32.537225 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23b3d-c16b-466c-80f2-aba10fbb0585 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:32.537499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23b3d-c16b-466c-80f2-aba10fbb0585 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:32.537772 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23b3d-c16b-466c-80f2-aba10fbb0585 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:32.549762 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a23b3d-c16b-466c-80f2-aba10fbb0585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:49:32.557295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-f1a23b3d-c16b-466c-80f2-aba10fbb0585 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:49:32.557295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:49:32.557295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:49:32.557295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:49:32.557295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:49:32.557295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:49:32.557295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:49:32.557295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:49:32.557295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:49:32.557295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:49:32.557295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:49:32.557295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:49:32.557295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:49:32.557295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:49:32.557295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:49:32.557295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:49:32.558451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:49:32.558451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:49:32.558451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:49:32.558451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:49:32.558451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:49:32.558451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:49:32.558451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:49:32.558451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:49:32.558451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:49:32.558451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:49:32.558451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:49:32.558451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:49:32.558451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:49:32.558451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:49:32.558451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:49:32.558451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:49:32.559830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:49:32.559830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:49:32.559830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:49:32.559830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:49:32.559830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:49:32.559830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:49:32.559830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:49:32.559830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:49:32.559830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:49:32.559830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:49:32.559830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:49:32.559830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:49:32.559830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 593/1180] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:49:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:49:32.567894 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfca5c-1322-466f-9bd4-828a8c96250c None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:32.674186 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfca5c-1322-466f-9bd4-828a8c96250c None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:32.707623 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36469abc-f52a-40df-b767-4fb5f07cc8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:32.708279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36469abc-f52a-40df-b767-4fb5f07cc8bc None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:32.708561 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36469abc-f52a-40df-b767-4fb5f07cc8bc None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:32.708837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36469abc-f52a-40df-b767-4fb5f07cc8bc None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:32.709582 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36469abc-f52a-40df-b767-4fb5f07cc8bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:49:32.709922 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36469abc-f52a-40df-b767-4fb5f07cc8bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:32.711485 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36469abc-f52a-40df-b767-4fb5f07cc8bc None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:32.719410 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 588/1181] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:49:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:32.726004 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a23b3d-c16b-466c-80f2-aba10fbb0585 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:32.832197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a23b3d-c16b-466c-80f2-aba10fbb0585 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:32.870181 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a8410-a78b-485d-a637-574bb032e0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:32.871041 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a8410-a78b-485d-a637-574bb032e0c2 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:32.871326 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a8410-a78b-485d-a637-574bb032e0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:32.871599 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a8410-a78b-485d-a637-574bb032e0c2 None admin] PATH_INFO: `/v3/users/54bdb5dd1e774fffa2505f0c7fe704d2` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:32.885627 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a8410-a78b-485d-a637-574bb032e0c2 None admin] RBAC: Authorizing `identity:get_user(user_id=54bdb5dd1e774fffa2505f0c7fe704d2)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:32.887098 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a8410-a78b-485d-a637-574bb032e0c2 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:32.888733 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 594/1182] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:49:32 2022] GET /identity/v3/users/54bdb5dd1e774fffa2505f0c7fe704d2 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:32.895035 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36469abc-f52a-40df-b767-4fb5f07cc8bc None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:33.000986 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36469abc-f52a-40df-b767-4fb5f07cc8bc None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:33.036865 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b5835-67f3-4dda-8927-af3bfc56ddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:33.037493 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b5835-67f3-4dda-8927-af3bfc56ddeb None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:33.037770 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b5835-67f3-4dda-8927-af3bfc56ddeb None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:33.038068 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b5835-67f3-4dda-8927-af3bfc56ddeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:33.104290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b5835-67f3-4dda-8927-af3bfc56ddeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:33.105667 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b5835-67f3-4dda-8927-af3bfc56ddeb None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:33.215499 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 589/1183] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:49:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:49:33.225045 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a8410-a78b-485d-a637-574bb032e0c2 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:33.328553 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a8410-a78b-485d-a637-574bb032e0c2 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:33.365576 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a748b-2f27-4e9f-b5aa-87e0ae878697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:33.366396 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a748b-2f27-4e9f-b5aa-87e0ae878697 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:33.366729 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a748b-2f27-4e9f-b5aa-87e0ae878697 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:33.367005 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a748b-2f27-4e9f-b5aa-87e0ae878697 None admin] PATH_INFO: `/v3/projects/0288efff6afd432f8fb2ff8627b459ea` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:33.368216 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a748b-2f27-4e9f-b5aa-87e0ae878697 None admin] RBAC: Authorizing `identity:get_project(project_id=0288efff6afd432f8fb2ff8627b459ea)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:33.369650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a748b-2f27-4e9f-b5aa-87e0ae878697 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:33.371375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 595/1184] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:49:33 2022] GET /identity/v3/projects/0288efff6afd432f8fb2ff8627b459ea => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:33.378298 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b5835-67f3-4dda-8927-af3bfc56ddeb None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:33.486117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b5835-67f3-4dda-8927-af3bfc56ddeb None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:33.524118 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8710e1-46fb-42cb-b4e6-352c0a68af64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:33.524755 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8710e1-46fb-42cb-b4e6-352c0a68af64 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:33.525030 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8710e1-46fb-42cb-b4e6-352c0a68af64 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:33.525297 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8710e1-46fb-42cb-b4e6-352c0a68af64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:33.526148 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8710e1-46fb-42cb-b4e6-352c0a68af64 None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=0288efff6afd432f8fb2ff8627b459ea, user.id=54bdb5dd1e774fffa2505f0c7fe704d2) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:49:33.526458 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8710e1-46fb-42cb-b4e6-352c0a68af64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:33.527867 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8710e1-46fb-42cb-b4e6-352c0a68af64 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:33.538540 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 590/1185] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:49:33 2022] GET /identity/v3/role_assignments?user.id=54bdb5dd1e774fffa2505f0c7fe704d2&scope.project.id=0288efff6afd432f8fb2ff8627b459ea&role.id=52d3ad3e32c741938997691c9a909b81 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:35.723117 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504fe4e-cffe-4198-8a11-b0433d0c9a70 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:35.723998 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504fe4e-cffe-4198-8a11-b0433d0c9a70 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:35.723998 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504fe4e-cffe-4198-8a11-b0433d0c9a70 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:35.726247 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 596/1186] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:49:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:49:35.732553 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473da2d-ab3f-439a-a0a6-62a41af7ab09 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:35.732994 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473da2d-ab3f-439a-a0a6-62a41af7ab09 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:35.733121 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473da2d-ab3f-439a-a0a6-62a41af7ab09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:35.753446 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-2473da2d-ab3f-439a-a0a6-62a41af7ab09 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:49:35.754651 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-2473da2d-ab3f-439a-a0a6-62a41af7ab09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:49:35.822918 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 591/1187] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:49:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:49:35.846532 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504fe4e-cffe-4198-8a11-b0433d0c9a70 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:35.969767 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504fe4e-cffe-4198-8a11-b0433d0c9a70 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:36.006051 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66531242-8c0b-48ab-806e-830c28557e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:36.006755 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66531242-8c0b-48ab-806e-830c28557e4b None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:36.007028 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66531242-8c0b-48ab-806e-830c28557e4b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:36.007335 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66531242-8c0b-48ab-806e-830c28557e4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:36.018015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66531242-8c0b-48ab-806e-830c28557e4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:49:36.025476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-66531242-8c0b-48ab-806e-830c28557e4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:49:36.025476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:49:36.025476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:49:36.025476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:49:36.025476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:49:36.025476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:49:36.025476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:49:36.025476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:49:36.025476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:49:36.025476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:49:36.025476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:49:36.025476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:49:36.025476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:49:36.025476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:49:36.025476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:49:36.025476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:49:36.026577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:49:36.026577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:49:36.026577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:49:36.026577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:49:36.026577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:49:36.026577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:49:36.026577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:49:36.026577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:49:36.026577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:49:36.026577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:49:36.026577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:49:36.026577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:49:36.026577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:49:36.026577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:49:36.026577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:49:36.026577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:49:36.027545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:49:36.027545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:49:36.027545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:49:36.027545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:49:36.027545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:49:36.027545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:49:36.027545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:49:36.027545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:49:36.027545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:49:36.027545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:49:36.027545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:49:36.027545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:49:36.027545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 597/1188] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:49:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:49:36.033470 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473da2d-ab3f-439a-a0a6-62a41af7ab09 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:36.133851 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473da2d-ab3f-439a-a0a6-62a41af7ab09 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:36.168535 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c17176-56ae-4274-b56f-be2610967acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:36.169185 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c17176-56ae-4274-b56f-be2610967acc None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:36.169466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c17176-56ae-4274-b56f-be2610967acc None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:36.169731 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c17176-56ae-4274-b56f-be2610967acc None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:36.170502 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c17176-56ae-4274-b56f-be2610967acc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:49:36.170814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c17176-56ae-4274-b56f-be2610967acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:36.172183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c17176-56ae-4274-b56f-be2610967acc None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:36.180302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 592/1189] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:49:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:49:36.190808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66531242-8c0b-48ab-806e-830c28557e4b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:36.305105 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66531242-8c0b-48ab-806e-830c28557e4b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:36.338615 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb39a0-df88-4f84-a8b2-dc8f11359460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:36.339481 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb39a0-df88-4f84-a8b2-dc8f11359460 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:36.339761 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb39a0-df88-4f84-a8b2-dc8f11359460 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:36.340035 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb39a0-df88-4f84-a8b2-dc8f11359460 None admin] PATH_INFO: `/v3/users/54bdb5dd1e774fffa2505f0c7fe704d2` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:36.341323 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb39a0-df88-4f84-a8b2-dc8f11359460 None admin] RBAC: Authorizing `identity:get_user(user_id=54bdb5dd1e774fffa2505f0c7fe704d2)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:36.342780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb39a0-df88-4f84-a8b2-dc8f11359460 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:36.344395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 598/1190] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:49:36 2022] GET /identity/v3/users/54bdb5dd1e774fffa2505f0c7fe704d2 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:36.351128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c17176-56ae-4274-b56f-be2610967acc None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:36.460413 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c17176-56ae-4274-b56f-be2610967acc None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:36.496959 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281a6eb-3167-4fbe-9821-d626a193252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:36.497840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281a6eb-3167-4fbe-9821-d626a193252d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:36.498107 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281a6eb-3167-4fbe-9821-d626a193252d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:36.498369 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281a6eb-3167-4fbe-9821-d626a193252d None admin] PATH_INFO: `/v3/projects/0288efff6afd432f8fb2ff8627b459ea` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:36.499571 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281a6eb-3167-4fbe-9821-d626a193252d None admin] RBAC: Authorizing `identity:get_project(project_id=0288efff6afd432f8fb2ff8627b459ea)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:36.500988 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281a6eb-3167-4fbe-9821-d626a193252d None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:36.502709 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 593/1191] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:49:36 2022] GET /identity/v3/projects/0288efff6afd432f8fb2ff8627b459ea => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:36.508900 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb39a0-df88-4f84-a8b2-dc8f11359460 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:36.611044 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb39a0-df88-4f84-a8b2-dc8f11359460 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:36.644493 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d42bf-ec98-4d9e-9f75-0f6e5617012b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:36.645357 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d42bf-ec98-4d9e-9f75-0f6e5617012b None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:36.645628 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d42bf-ec98-4d9e-9f75-0f6e5617012b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:36.645918 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d42bf-ec98-4d9e-9f75-0f6e5617012b None admin] PATH_INFO: `/v3/projects/0288efff6afd432f8fb2ff8627b459ea/users/54bdb5dd1e774fffa2505f0c7fe704d2/roles/52d3ad3e32c741938997691c9a909b81` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:36.647992 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d42bf-ec98-4d9e-9f75-0f6e5617012b None admin] RBAC: Authorizing `identity:create_grant(project_id=0288efff6afd432f8fb2ff8627b459ea, user_id=54bdb5dd1e774fffa2505f0c7fe704d2, role_id=52d3ad3e32c741938997691c9a909b81)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:36.649339 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d42bf-ec98-4d9e-9f75-0f6e5617012b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:36.665465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 599/1192] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:49:36 2022] PUT /identity/v3/projects/0288efff6afd432f8fb2ff8627b459ea/users/54bdb5dd1e774fffa2505f0c7fe704d2/roles/52d3ad3e32c741938997691c9a909b81 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:49:38.850189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e464d2b-cfe6-498e-9e28-03e335dc9052 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:38.850766 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e464d2b-cfe6-498e-9e28-03e335dc9052 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:38.850766 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e464d2b-cfe6-498e-9e28-03e335dc9052 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:38.852750 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 594/1193] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:49:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:49:38.860619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d15a3-f179-4dea-8465-fb81c11c11cd None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:38.861078 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d15a3-f179-4dea-8465-fb81c11c11cd None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:38.861169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d15a3-f179-4dea-8465-fb81c11c11cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:38.879469 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-aa8d15a3-f179-4dea-8465-fb81c11c11cd None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:49:38.880627 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-aa8d15a3-f179-4dea-8465-fb81c11c11cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:49:38.945660 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 600/1194] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:49:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 09:49:38.981010 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e464d2b-cfe6-498e-9e28-03e335dc9052 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:39.081528 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e464d2b-cfe6-498e-9e28-03e335dc9052 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:39.114259 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1a7c2-cfe7-458c-9c3e-f7c504e56a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:39.114967 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1a7c2-cfe7-458c-9c3e-f7c504e56a06 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:39.115238 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1a7c2-cfe7-458c-9c3e-f7c504e56a06 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:39.115502 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1a7c2-cfe7-458c-9c3e-f7c504e56a06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:39.126038 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1a7c2-cfe7-458c-9c3e-f7c504e56a06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:49:39.133504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-0ce1a7c2-cfe7-458c-9c3e-f7c504e56a06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:49:39.133504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:49:39.133504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:49:39.133504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:49:39.133504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:49:39.133504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:49:39.133504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:49:39.133504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:49:39.133504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:49:39.133504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:49:39.133504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:49:39.133504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:49:39.133504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:49:39.133504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:49:39.133504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:49:39.133504 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:49:39.134586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:49:39.134586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:49:39.134586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:49:39.134586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:49:39.134586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:49:39.134586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:49:39.134586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:49:39.134586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:49:39.134586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:49:39.134586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:49:39.134586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:49:39.134586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:49:39.134586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:49:39.134586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:49:39.134586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:49:39.134586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:49:39.135956 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:49:39.135956 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:49:39.135956 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:49:39.135956 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:49:39.135956 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:49:39.135956 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:49:39.135956 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:49:39.135956 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:49:39.135956 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:49:39.135956 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:49:39.135956 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:49:39.135956 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:49:39.135956 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 595/1195] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:49:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:49:39.140966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d15a3-f179-4dea-8465-fb81c11c11cd None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:39.240835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d15a3-f179-4dea-8465-fb81c11c11cd None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:39.275269 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c08ea0-4b55-4f05-9d8c-d975334a9f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:39.275929 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c08ea0-4b55-4f05-9d8c-d975334a9f58 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:39.276206 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c08ea0-4b55-4f05-9d8c-d975334a9f58 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:39.276471 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c08ea0-4b55-4f05-9d8c-d975334a9f58 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:39.277212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c08ea0-4b55-4f05-9d8c-d975334a9f58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:49:39.277508 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c08ea0-4b55-4f05-9d8c-d975334a9f58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:39.278901 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c08ea0-4b55-4f05-9d8c-d975334a9f58 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:39.286911 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 601/1196] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:49:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:49:39.293021 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1a7c2-cfe7-458c-9c3e-f7c504e56a06 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:39.391592 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1a7c2-cfe7-458c-9c3e-f7c504e56a06 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:39.425102 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65978306-b14b-4ba3-a06f-fd1d308986e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:39.425983 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65978306-b14b-4ba3-a06f-fd1d308986e0 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:39.426257 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65978306-b14b-4ba3-a06f-fd1d308986e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:39.426525 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65978306-b14b-4ba3-a06f-fd1d308986e0 None admin] PATH_INFO: `/v3/users/54bdb5dd1e774fffa2505f0c7fe704d2` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:39.427840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65978306-b14b-4ba3-a06f-fd1d308986e0 None admin] RBAC: Authorizing `identity:get_user(user_id=54bdb5dd1e774fffa2505f0c7fe704d2)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:39.429368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65978306-b14b-4ba3-a06f-fd1d308986e0 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:39.431024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 596/1197] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 3 09:49:39 2022] GET /identity/v3/users/54bdb5dd1e774fffa2505f0c7fe704d2 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:39.437643 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c08ea0-4b55-4f05-9d8c-d975334a9f58 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:39.552755 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c08ea0-4b55-4f05-9d8c-d975334a9f58 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:39.591763 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bdfcb-f402-402f-922d-54093e31faf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:39.592398 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bdfcb-f402-402f-922d-54093e31faf2 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:39.592651 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bdfcb-f402-402f-922d-54093e31faf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:39.592924 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bdfcb-f402-402f-922d-54093e31faf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:39.663645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bdfcb-f402-402f-922d-54093e31faf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:39.665137 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bdfcb-f402-402f-922d-54093e31faf2 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:39.764180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 602/1198] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:49:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:49:39.770626 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65978306-b14b-4ba3-a06f-fd1d308986e0 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:39.882950 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65978306-b14b-4ba3-a06f-fd1d308986e0 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:39.917106 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c874d-871f-4063-a394-8ec7ee0184a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:39.917895 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c874d-871f-4063-a394-8ec7ee0184a6 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:39.918164 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c874d-871f-4063-a394-8ec7ee0184a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:39.918429 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c874d-871f-4063-a394-8ec7ee0184a6 None admin] PATH_INFO: `/v3/projects/0288efff6afd432f8fb2ff8627b459ea` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:39.919619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c874d-871f-4063-a394-8ec7ee0184a6 None admin] RBAC: Authorizing `identity:get_project(project_id=0288efff6afd432f8fb2ff8627b459ea)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:39.921030 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c874d-871f-4063-a394-8ec7ee0184a6 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:39.922727 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 597/1199] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 3 09:49:39 2022] GET /identity/v3/projects/0288efff6afd432f8fb2ff8627b459ea => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:49:39.929390 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bdfcb-f402-402f-922d-54093e31faf2 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:49:40.031289 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bdfcb-f402-402f-922d-54093e31faf2 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:49:40.065126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6fd4b-b62d-46ba-82e1-7be8cd22af60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:49:40.065773 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6fd4b-b62d-46ba-82e1-7be8cd22af60 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:49:40.066087 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6fd4b-b62d-46ba-82e1-7be8cd22af60 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:49:40.066359 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6fd4b-b62d-46ba-82e1-7be8cd22af60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:49:40.067184 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6fd4b-b62d-46ba-82e1-7be8cd22af60 None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=0288efff6afd432f8fb2ff8627b459ea, user.id=54bdb5dd1e774fffa2505f0c7fe704d2) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:49:40.067488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6fd4b-b62d-46ba-82e1-7be8cd22af60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:49:40.068913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6fd4b-b62d-46ba-82e1-7be8cd22af60 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:49:40.074873 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 603/1200] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:49:39 2022] GET /identity/v3/role_assignments?user.id=54bdb5dd1e774fffa2505f0c7fe704d2&scope.project.id=0288efff6afd432f8fb2ff8627b459ea&role.id=52d3ad3e32c741938997691c9a909b81 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:40.625845 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2c36c-6e9c-4796-9057-71b61121db6e None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:40.625845 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2c36c-6e9c-4796-9057-71b61121db6e None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:40.625845 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2c36c-6e9c-4796-9057-71b61121db6e None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:40.627700 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 598/1201] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:50:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:50:40.632059 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e3c87-40a8-4354-bfb4-8a4d4cead69f None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:40.632709 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e3c87-40a8-4354-bfb4-8a4d4cead69f None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:40.633468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e3c87-40a8-4354-bfb4-8a4d4cead69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:40.658813 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-3c3e3c87-40a8-4354-bfb4-8a4d4cead69f None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:50:40.660285 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-3c3e3c87-40a8-4354-bfb4-8a4d4cead69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:50:40.772442 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 604/1202] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:50:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:50:40.798390 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2c36c-6e9c-4796-9057-71b61121db6e None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:40.922557 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2c36c-6e9c-4796-9057-71b61121db6e None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:40.970296 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7612a-c643-465b-a412-66bb753d76fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:40.971215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7612a-c643-465b-a412-66bb753d76fd None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:40.971549 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7612a-c643-465b-a412-66bb753d76fd None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:40.971819 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7612a-c643-465b-a412-66bb753d76fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:40.985209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7612a-c643-465b-a412-66bb753d76fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:40.985209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7612a-c643-465b-a412-66bb753d76fd None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:41.006909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-03e7612a-c643-465b-a412-66bb753d76fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:41.006909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:41.006909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:41.006909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:41.006909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:41.006909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:41.006909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:41.006909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:41.006909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:41.006909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:41.006909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:41.006909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:41.006909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:50:41.006909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:50:41.006909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:50:41.008242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:50:41.008242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:41.008242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:41.008242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:41.008242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:41.008242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:41.008242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:41.008242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:41.008242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:50:41.008242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:41.008242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:41.008242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:41.008242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:41.008242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:41.008242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:41.008242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:41.008242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:41.009257 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:50:41.009257 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:50:41.009257 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:41.009257 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:50:41.009257 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 599/1203] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:41.015271 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e3c87-40a8-4354-bfb4-8a4d4cead69f None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:41.135673 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e3c87-40a8-4354-bfb4-8a4d4cead69f None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:41.184670 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b1a09-0a58-4fed-a16a-89f1408514e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:41.185255 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b1a09-0a58-4fed-a16a-89f1408514e6 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:41.185532 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b1a09-0a58-4fed-a16a-89f1408514e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:41.185817 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b1a09-0a58-4fed-a16a-89f1408514e6 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:41.186539 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b1a09-0a58-4fed-a16a-89f1408514e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:41.186838 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b1a09-0a58-4fed-a16a-89f1408514e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:41.188197 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b1a09-0a58-4fed-a16a-89f1408514e6 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:41.207225 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 605/1204] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:41.207436 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7612a-c643-465b-a412-66bb753d76fd None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:41.321287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7612a-c643-465b-a412-66bb753d76fd None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:41.377357 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf214e0-c633-4f0c-8717-3a0f1305bd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:41.378518 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf214e0-c633-4f0c-8717-3a0f1305bd52 None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:41.378862 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf214e0-c633-4f0c-8717-3a0f1305bd52 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:41.379138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf214e0-c633-4f0c-8717-3a0f1305bd52 None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:41.379955 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf214e0-c633-4f0c-8717-3a0f1305bd52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:41.381571 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf214e0-c633-4f0c-8717-3a0f1305bd52 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:41.425822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 600/1205] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 3 09:50:41 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 09:50:43.875128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e2b6c-e538-4675-9a47-744f0656ca3a None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:43.875782 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e2b6c-e538-4675-9a47-744f0656ca3a None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:43.875782 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e2b6c-e538-4675-9a47-744f0656ca3a None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:43.877043 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 606/1206] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:50:43.882445 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e9d04-18ff-42b3-99bd-97912c69d6ab None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:43.883046 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e9d04-18ff-42b3-99bd-97912c69d6ab None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:43.883046 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e9d04-18ff-42b3-99bd-97912c69d6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:43.901167 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-8a2e9d04-18ff-42b3-99bd-97912c69d6ab None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:50:43.902357 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-8a2e9d04-18ff-42b3-99bd-97912c69d6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:50:43.974549 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 601/1207] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:50:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:50:43.997947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e2b6c-e538-4675-9a47-744f0656ca3a None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:44.119883 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e2b6c-e538-4675-9a47-744f0656ca3a None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:44.161090 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a28e3-2106-4ac5-9038-18de53fa76b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:44.162222 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a28e3-2106-4ac5-9038-18de53fa76b2 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:44.162937 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a28e3-2106-4ac5-9038-18de53fa76b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:44.163360 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a28e3-2106-4ac5-9038-18de53fa76b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:44.179121 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a28e3-2106-4ac5-9038-18de53fa76b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:50:44.191186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-695a28e3-2106-4ac5-9038-18de53fa76b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:50:44.191186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:44.191186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:44.191186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:44.191186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:44.191186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:44.191186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:44.191186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:44.191186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:44.191186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:44.191186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:44.191186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:44.191186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:50:44.191186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:50:44.191186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:50:44.191186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:50:44.192426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:50:44.192426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:50:44.192426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:50:44.192426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:50:44.192426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:44.192426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:44.192426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:44.192426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:44.192426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:44.192426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:44.192426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:44.192426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:50:44.192426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:44.192426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:44.192426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:44.192426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:44.193390 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:44.193390 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:44.193390 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:44.193390 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:44.193390 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:50:44.193390 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:50:44.193390 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:50:44.193390 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:50:44.193390 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:50:44.193390 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:50:44.193390 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:50:44.193390 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:50:44.193390 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 607/1208] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:50:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:50:44.199321 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e9d04-18ff-42b3-99bd-97912c69d6ab None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:44.312851 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e9d04-18ff-42b3-99bd-97912c69d6ab None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:44.349209 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3b7d8-f358-440b-9157-303b082e6a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:44.349920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3b7d8-f358-440b-9157-303b082e6a84 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:44.349920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3b7d8-f358-440b-9157-303b082e6a84 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:44.349920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3b7d8-f358-440b-9157-303b082e6a84 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:44.349920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3b7d8-f358-440b-9157-303b082e6a84 None admin] RBAC: Adding query filter params (name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:44.349920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3b7d8-f358-440b-9157-303b082e6a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:44.353231 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3b7d8-f358-440b-9157-303b082e6a84 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:44.361700 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 602/1209] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:50:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:50:44.368054 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a28e3-2106-4ac5-9038-18de53fa76b2 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:44.479705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a28e3-2106-4ac5-9038-18de53fa76b2 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:44.516570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981e9f0-f077-45ca-a4b4-955e14551d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:44.517371 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981e9f0-f077-45ca-a4b4-955e14551d09 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:44.517651 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981e9f0-f077-45ca-a4b4-955e14551d09 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:44.518090 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981e9f0-f077-45ca-a4b4-955e14551d09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:44.528684 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981e9f0-f077-45ca-a4b4-955e14551d09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:44.530209 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981e9f0-f077-45ca-a4b4-955e14551d09 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:44.550975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-8981e9f0-f077-45ca-a4b4-955e14551d09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:44.550975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:44.550975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:44.550975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:44.550975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:44.550975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:44.550975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:44.550975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:44.550975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:44.550975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:44.550975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:44.550975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:44.550975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:50:44.550975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:50:44.550975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:50:44.552262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:50:44.552262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:44.552262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:44.552262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:44.552262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:44.552262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:44.552262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:44.552262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:44.552262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:50:44.552262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:44.552262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:44.552262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:44.552262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:44.552262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:44.552262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:44.552262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:44.552262 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:44.553412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:50:44.553412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:50:44.553412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:44.553412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:50:44.553412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 608/1210] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:50:44.558138 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3b7d8-f358-440b-9157-303b082e6a84 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:44.678822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3b7d8-f358-440b-9157-303b082e6a84 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:44.719841 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23048e2e-ebb8-4a87-a989-09cac7c3e564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:44.720606 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23048e2e-ebb8-4a87-a989-09cac7c3e564 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:44.720934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23048e2e-ebb8-4a87-a989-09cac7c3e564 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:44.721208 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23048e2e-ebb8-4a87-a989-09cac7c3e564 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:44.722029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23048e2e-ebb8-4a87-a989-09cac7c3e564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:44.724969 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23048e2e-ebb8-4a87-a989-09cac7c3e564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:44.726776 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23048e2e-ebb8-4a87-a989-09cac7c3e564 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:44.739981 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 603/1211] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:44.745341 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981e9f0-f077-45ca-a4b4-955e14551d09 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:44.853973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981e9f0-f077-45ca-a4b4-955e14551d09 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:44.893205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5922615-3fbf-4fd2-83a6-933bb1bd4818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:44.894048 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5922615-3fbf-4fd2-83a6-933bb1bd4818 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:44.894327 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5922615-3fbf-4fd2-83a6-933bb1bd4818 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:44.894597 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5922615-3fbf-4fd2-83a6-933bb1bd4818 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:44.902224 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5922615-3fbf-4fd2-83a6-933bb1bd4818 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:44.903979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5922615-3fbf-4fd2-83a6-933bb1bd4818 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:44.921363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-e5922615-3fbf-4fd2-83a6-933bb1bd4818 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 09:50:44.921363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:44.921363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:44.921363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:44.921363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:44.921363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:44.921363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:44.921363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:44.921363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:44.921363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:44.921363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:44.921363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:44.921363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:50:44.921363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:50:44.921363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:50:44.921363 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:44.922611 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:44.923570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:44.923570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:44.923570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:50:44.923570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:50:44.923570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:50:44.923570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:50:44.923570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:50:44.923570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:50:44.923570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 09:50:44.923570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:50:44.923570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 609/1212] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:50:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:44.929469 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23048e2e-ebb8-4a87-a989-09cac7c3e564 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:45.034931 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23048e2e-ebb8-4a87-a989-09cac7c3e564 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:45.068728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0c814-c891-4b6c-9210-f7a126d98b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:45.069461 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c814-c891-4b6c-9210-f7a126d98b21 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:45.069744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c814-c891-4b6c-9210-f7a126d98b21 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:45.070127 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c814-c891-4b6c-9210-f7a126d98b21 None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:45.071039 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0c814-c891-4b6c-9210-f7a126d98b21 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:45.071349 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0c814-c891-4b6c-9210-f7a126d98b21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:45.072780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0c814-c891-4b6c-9210-f7a126d98b21 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:45.091667 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 604/1213] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 3 09:50:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:50:45.098984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5922615-3fbf-4fd2-83a6-933bb1bd4818 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:45.203693 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5922615-3fbf-4fd2-83a6-933bb1bd4818 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:45.238153 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59b841-3b7e-4b27-abd2-c7c2b89848d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:45.238857 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59b841-3b7e-4b27-abd2-c7c2b89848d9 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:45.239176 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59b841-3b7e-4b27-abd2-c7c2b89848d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:45.239507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59b841-3b7e-4b27-abd2-c7c2b89848d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:45.313933 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59b841-3b7e-4b27-abd2-c7c2b89848d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:45.315377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59b841-3b7e-4b27-abd2-c7c2b89848d9 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:45.415650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 610/1214] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:50:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 09:50:45.421476 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0c814-c891-4b6c-9210-f7a126d98b21 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:45.537582 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0c814-c891-4b6c-9210-f7a126d98b21 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:45.575324 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bac4bc-20f0-450e-a21d-ebfe59d02a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:45.575732 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bac4bc-20f0-450e-a21d-ebfe59d02a0f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:45.576006 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bac4bc-20f0-450e-a21d-ebfe59d02a0f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:45.576269 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bac4bc-20f0-450e-a21d-ebfe59d02a0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:45.587080 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bac4bc-20f0-450e-a21d-ebfe59d02a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:45.588660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bac4bc-20f0-450e-a21d-ebfe59d02a0f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:45.608192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-38bac4bc-20f0-450e-a21d-ebfe59d02a0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:45.608192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:45.608192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:45.608192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:45.608192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:45.608192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:45.608192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:45.608192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:45.608192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:45.608192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:45.608192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:45.608192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:45.608192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:50:45.608192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:50:45.608192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:50:45.609176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:50:45.609176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:45.609176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:45.609176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:45.609176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:45.609176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:45.609176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:45.609176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:45.609176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:50:45.609176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:45.609176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:45.609176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:45.609176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:45.609176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:45.609176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:45.609176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:45.609176 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:45.610262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:50:45.610262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:50:45.610262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:45.610262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:50:45.610262 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 605/1215] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:45.615327 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59b841-3b7e-4b27-abd2-c7c2b89848d9 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:45.723099 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59b841-3b7e-4b27-abd2-c7c2b89848d9 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:45.762581 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e42fc-6f5d-45a4-8250-fc4d032be508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:45.763302 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e42fc-6f5d-45a4-8250-fc4d032be508 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:45.763634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e42fc-6f5d-45a4-8250-fc4d032be508 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:45.764041 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e42fc-6f5d-45a4-8250-fc4d032be508 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:45.765077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e42fc-6f5d-45a4-8250-fc4d032be508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:45.765496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e42fc-6f5d-45a4-8250-fc4d032be508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:45.767532 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e42fc-6f5d-45a4-8250-fc4d032be508 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:45.787449 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 611/1216] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:50:45.788702 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bac4bc-20f0-450e-a21d-ebfe59d02a0f None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:45.900830 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bac4bc-20f0-450e-a21d-ebfe59d02a0f None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:45.943322 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dedc8-be24-4b94-8fd8-ca9841fd2353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:45.944143 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dedc8-be24-4b94-8fd8-ca9841fd2353 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:45.944466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dedc8-be24-4b94-8fd8-ca9841fd2353 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:45.944735 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dedc8-be24-4b94-8fd8-ca9841fd2353 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:45.954988 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dedc8-be24-4b94-8fd8-ca9841fd2353 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:45.954988 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dedc8-be24-4b94-8fd8-ca9841fd2353 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:45.971481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-169dedc8-be24-4b94-8fd8-ca9841fd2353 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:50:45.971481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:45.971481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:45.971481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:45.971481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:45.971481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:45.971481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:45.971481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:45.971481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:45.971481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:45.971481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:45.971481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:45.971481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:50:45.971481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:50:45.971481 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:50:45.972605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:50:45.972605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:45.972605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:45.972605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:45.972605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:45.972605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:45.972605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:45.972605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:45.972605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:50:45.972605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:45.972605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:45.972605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:45.972605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:45.972605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:45.972605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:45.972605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:45.972605 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:45.973497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:50:45.973497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:50:45.973497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:50:45.973497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:50:45.973497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:50:45.973497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:50:45.973497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:50:45.973497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:50:45.973497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 606/1217] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:50:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:45.979696 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e42fc-6f5d-45a4-8250-fc4d032be508 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:46.095221 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e42fc-6f5d-45a4-8250-fc4d032be508 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:46.131579 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd1317-d023-4fc4-bbe0-eb612642f6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:46.132352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd1317-d023-4fc4-bbe0-eb612642f6fd None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:46.132681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd1317-d023-4fc4-bbe0-eb612642f6fd None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:46.132947 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd1317-d023-4fc4-bbe0-eb612642f6fd None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:46.133817 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd1317-d023-4fc4-bbe0-eb612642f6fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:46.134122 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd1317-d023-4fc4-bbe0-eb612642f6fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:46.135730 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd1317-d023-4fc4-bbe0-eb612642f6fd None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:46.154331 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 612/1218] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:50:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:46.155840 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dedc8-be24-4b94-8fd8-ca9841fd2353 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:46.272130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dedc8-be24-4b94-8fd8-ca9841fd2353 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:46.309778 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655a7e6-9864-4c67-97de-cd1465b4a607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:46.310544 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655a7e6-9864-4c67-97de-cd1465b4a607 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:46.310820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655a7e6-9864-4c67-97de-cd1465b4a607 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:46.311162 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655a7e6-9864-4c67-97de-cd1465b4a607 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:46.312024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655a7e6-9864-4c67-97de-cd1465b4a607 None admin] RBAC: Adding query filter params (role.id=779b01e1e2534bfba9971e7000b7c628, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=26bee0f9d8c341fca8290b2fbc95e1e8) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:46.312363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655a7e6-9864-4c67-97de-cd1465b4a607 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:46.313890 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655a7e6-9864-4c67-97de-cd1465b4a607 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:46.319641 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 607/1219] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:50:46 2022] GET /identity/v3/role_assignments?user.id=26bee0f9d8c341fca8290b2fbc95e1e8&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=779b01e1e2534bfba9971e7000b7c628 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:48.578815 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8367b-d9fe-4658-ab42-ef33b5b599e9 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:48.579388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8367b-d9fe-4658-ab42-ef33b5b599e9 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:48.579388 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8367b-d9fe-4658-ab42-ef33b5b599e9 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:48.580890 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 613/1220] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:50:48.587123 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3f0f7-7736-4753-8e83-c890c22c8a94 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:48.587699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3f0f7-7736-4753-8e83-c890c22c8a94 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:48.587699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3f0f7-7736-4753-8e83-c890c22c8a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:48.605235 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-a2d3f0f7-7736-4753-8e83-c890c22c8a94 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:50:48.606520 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-a2d3f0f7-7736-4753-8e83-c890c22c8a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:50:48.682071 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 608/1221] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:50:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:50:48.705108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8367b-d9fe-4658-ab42-ef33b5b599e9 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:48.813223 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8367b-d9fe-4658-ab42-ef33b5b599e9 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:48.848780 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac8837-f8fb-4de8-b768-fc4114879424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:48.849528 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac8837-f8fb-4de8-b768-fc4114879424 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:48.849857 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac8837-f8fb-4de8-b768-fc4114879424 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:48.850126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac8837-f8fb-4de8-b768-fc4114879424 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:48.860634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac8837-f8fb-4de8-b768-fc4114879424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:50:48.868450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-0dac8837-f8fb-4de8-b768-fc4114879424 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:50:48.868450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:48.868450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:48.868450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:48.868450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:48.868450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:48.868450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:48.868450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:48.868450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:48.868450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:48.868450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:48.868450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:48.868450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:50:48.868450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:50:48.868450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:50:48.868450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:50:48.869595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:50:48.869595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:50:48.869595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:50:48.869595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:50:48.869595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:48.869595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:48.869595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:48.869595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:48.869595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:48.869595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:48.869595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:48.869595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:50:48.869595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:48.869595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:48.869595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:48.869595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:48.870861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:48.870861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:48.870861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:48.870861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:48.870861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:50:48.870861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:50:48.870861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:50:48.870861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:50:48.870861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:50:48.870861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:50:48.870861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:50:48.870861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:50:48.870861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 614/1222] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:50:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:48.875859 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3f0f7-7736-4753-8e83-c890c22c8a94 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:48.973152 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3f0f7-7736-4753-8e83-c890c22c8a94 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:49.006096 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4fff8-29ec-4298-8b9a-65260d406202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:49.006764 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4fff8-29ec-4298-8b9a-65260d406202 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:49.007036 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4fff8-29ec-4298-8b9a-65260d406202 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:49.007306 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4fff8-29ec-4298-8b9a-65260d406202 None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:49.008067 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4fff8-29ec-4298-8b9a-65260d406202 None admin] RBAC: Adding query filter params (name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:49.008364 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4fff8-29ec-4298-8b9a-65260d406202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:49.009711 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4fff8-29ec-4298-8b9a-65260d406202 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:49.018316 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 609/1223] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:50:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:49.025481 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac8837-f8fb-4de8-b768-fc4114879424 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:49.124891 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac8837-f8fb-4de8-b768-fc4114879424 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:49.160905 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aabb9e-ac92-4a89-82d1-5bc4336bfadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:49.161704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aabb9e-ac92-4a89-82d1-5bc4336bfadc None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:49.162045 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aabb9e-ac92-4a89-82d1-5bc4336bfadc None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:49.162313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aabb9e-ac92-4a89-82d1-5bc4336bfadc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:49.173344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aabb9e-ac92-4a89-82d1-5bc4336bfadc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:49.174828 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aabb9e-ac92-4a89-82d1-5bc4336bfadc None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:49.192480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-b4aabb9e-ac92-4a89-82d1-5bc4336bfadc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:49.192480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:49.192480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:49.192480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:49.192480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:49.192480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:49.192480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:49.192480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:49.192480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:49.192480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:49.192480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:49.192480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:49.192480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:50:49.192480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:50:49.192480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:50:49.193524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:50:49.193524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:49.193524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:49.193524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:49.193524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:49.193524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:49.193524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:49.193524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:49.193524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:50:49.193524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:49.193524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:49.193524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:49.193524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:49.193524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:49.193524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:49.193524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:49.193524 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:49.194488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:50:49.194488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:50:49.194488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:49.194488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:50:49.194488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 615/1224] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:49.199794 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4fff8-29ec-4298-8b9a-65260d406202 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:49.308505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4fff8-29ec-4298-8b9a-65260d406202 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:49.343018 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5cac4-7519-4c6b-88c9-646dda4100c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:49.343918 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5cac4-7519-4c6b-88c9-646dda4100c9 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:49.344192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5cac4-7519-4c6b-88c9-646dda4100c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:49.344514 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5cac4-7519-4c6b-88c9-646dda4100c9 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:49.345502 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5cac4-7519-4c6b-88c9-646dda4100c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:49.345860 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5cac4-7519-4c6b-88c9-646dda4100c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:49.347588 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5cac4-7519-4c6b-88c9-646dda4100c9 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:49.362327 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 610/1225] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:49.368476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aabb9e-ac92-4a89-82d1-5bc4336bfadc None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:49.468053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aabb9e-ac92-4a89-82d1-5bc4336bfadc None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:49.500438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51bd79-18f8-4adf-ab55-a04f8e9107b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:49.501295 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51bd79-18f8-4adf-ab55-a04f8e9107b3 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:49.501607 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51bd79-18f8-4adf-ab55-a04f8e9107b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:49.501934 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51bd79-18f8-4adf-ab55-a04f8e9107b3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:49.510248 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51bd79-18f8-4adf-ab55-a04f8e9107b3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:49.511820 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51bd79-18f8-4adf-ab55-a04f8e9107b3 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:49.527973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-2f51bd79-18f8-4adf-ab55-a04f8e9107b3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 09:50:49.527973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:49.527973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:49.527973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:49.527973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:49.527973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:49.527973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:49.527973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:49.527973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:49.527973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:49.527973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:49.527973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:49.527973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:50:49.527973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:50:49.527973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:50:49.527973 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:49.529073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:49.530079 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:49.530079 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:49.530079 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:50:49.530079 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:50:49.530079 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:50:49.530079 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:50:49.530079 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:50:49.530079 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:50:49.530079 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 09:50:49.530079 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:50:49.530079 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 616/1226] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:50:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:49.535422 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5cac4-7519-4c6b-88c9-646dda4100c9 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:49.640784 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5cac4-7519-4c6b-88c9-646dda4100c9 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:49.682791 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad7cb5-2806-4777-afa7-b54be5c2bcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:49.683709 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad7cb5-2806-4777-afa7-b54be5c2bcfd None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:49.684088 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad7cb5-2806-4777-afa7-b54be5c2bcfd None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:49.684422 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad7cb5-2806-4777-afa7-b54be5c2bcfd None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:49.685381 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad7cb5-2806-4777-afa7-b54be5c2bcfd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:49.685747 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad7cb5-2806-4777-afa7-b54be5c2bcfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:49.687433 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad7cb5-2806-4777-afa7-b54be5c2bcfd None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:49.706611 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 611/1227] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 3 09:50:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:49.713378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51bd79-18f8-4adf-ab55-a04f8e9107b3 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:49.826802 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51bd79-18f8-4adf-ab55-a04f8e9107b3 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:49.866631 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666d387-5bba-461e-9362-043a43d12655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:49.867903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666d387-5bba-461e-9362-043a43d12655 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:49.868242 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666d387-5bba-461e-9362-043a43d12655 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:49.868636 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666d387-5bba-461e-9362-043a43d12655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:49.879541 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666d387-5bba-461e-9362-043a43d12655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:49.880992 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666d387-5bba-461e-9362-043a43d12655 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:49.899296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-b666d387-5bba-461e-9362-043a43d12655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:49.899296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:49.899296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:49.899296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:49.899296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:49.899296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:49.899296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:49.899296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:49.899296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:49.899296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:49.899296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:49.899296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:49.899296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:50:49.899296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:50:49.899296 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:50:49.900534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:50:49.900534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:49.900534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:49.900534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:49.900534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:49.900534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:49.900534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:49.900534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:49.900534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:50:49.900534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:49.900534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:49.900534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:49.900534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:49.900534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:49.900534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:49.900534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:49.900534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:49.901449 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:50:49.901449 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:50:49.901449 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:49.901449 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:50:49.901449 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 617/1228] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:49.906428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad7cb5-2806-4777-afa7-b54be5c2bcfd None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:50.011402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad7cb5-2806-4777-afa7-b54be5c2bcfd None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:50.046790 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbebe0-5fb6-4855-826c-1db4ad28a726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:50.047475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbebe0-5fb6-4855-826c-1db4ad28a726 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:50.047749 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbebe0-5fb6-4855-826c-1db4ad28a726 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:50.048013 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbebe0-5fb6-4855-826c-1db4ad28a726 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:50.048725 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbebe0-5fb6-4855-826c-1db4ad28a726 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:50.049021 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbebe0-5fb6-4855-826c-1db4ad28a726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:50.050418 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbebe0-5fb6-4855-826c-1db4ad28a726 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:50.061389 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 612/1229] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:50.067124 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666d387-5bba-461e-9362-043a43d12655 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:50.169927 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666d387-5bba-461e-9362-043a43d12655 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:50.204483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9fce4-e883-4231-a9e8-27c0c6c76982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:50.205277 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9fce4-e883-4231-a9e8-27c0c6c76982 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:50.205554 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9fce4-e883-4231-a9e8-27c0c6c76982 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:50.205844 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9fce4-e883-4231-a9e8-27c0c6c76982 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:50.212649 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9fce4-e883-4231-a9e8-27c0c6c76982 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:50.214238 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9fce4-e883-4231-a9e8-27c0c6c76982 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:50.234869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-1ca9fce4-e883-4231-a9e8-27c0c6c76982 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:50:50.234869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:50.234869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:50.234869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:50.234869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:50.234869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:50.234869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:50.234869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:50.234869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:50.234869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:50.234869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:50.234869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:50.234869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:50:50.234869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:50:50.234869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:50:50.235928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:50:50.235928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:50.235928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:50.235928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:50.235928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:50.235928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:50.235928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:50.235928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:50.235928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:50:50.235928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:50.235928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:50.235928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:50.235928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:50.235928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:50.235928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:50.235928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:50.235928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:50.236846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:50:50.236846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:50:50.236846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:50:50.236846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:50:50.236846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:50:50.236846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:50:50.236846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:50:50.236846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:50:50.236846 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 618/1230] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:50.242870 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbebe0-5fb6-4855-826c-1db4ad28a726 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:50.354388 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbebe0-5fb6-4855-826c-1db4ad28a726 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:50.389204 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba881316-dded-4f5b-8835-1120d6de485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:50.390021 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba881316-dded-4f5b-8835-1120d6de485f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:50.390302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba881316-dded-4f5b-8835-1120d6de485f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:50.390578 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba881316-dded-4f5b-8835-1120d6de485f None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:50.391363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba881316-dded-4f5b-8835-1120d6de485f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:50.391673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba881316-dded-4f5b-8835-1120d6de485f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:50.393092 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba881316-dded-4f5b-8835-1120d6de485f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:50.406254 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 613/1231] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:50.412472 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9fce4-e883-4231-a9e8-27c0c6c76982 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:50.516646 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9fce4-e883-4231-a9e8-27c0c6c76982 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:50.557836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716788f-6bd2-4fca-ab93-c429a6536f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:50.558762 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716788f-6bd2-4fca-ab93-c429a6536f18 None admin] REQUEST_METHOD: `PUT` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:50.559045 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716788f-6bd2-4fca-ab93-c429a6536f18 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:50.559322 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716788f-6bd2-4fca-ab93-c429a6536f18 None admin] PATH_INFO: `/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/26bee0f9d8c341fca8290b2fbc95e1e8/roles/779b01e1e2534bfba9971e7000b7c628` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:50.573931 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716788f-6bd2-4fca-ab93-c429a6536f18 None admin] RBAC: Authorizing `identity:create_grant(project_id=f395f4842c39422d962dbddc4cf2897a, user_id=26bee0f9d8c341fca8290b2fbc95e1e8, role_id=779b01e1e2534bfba9971e7000b7c628)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:50.575490 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716788f-6bd2-4fca-ab93-c429a6536f18 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:50.587697 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 619/1232] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:50:50 2022] PUT /identity/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/26bee0f9d8c341fca8290b2fbc95e1e8/roles/779b01e1e2534bfba9971e7000b7c628 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:50:52.813255 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18005b-1e07-4afe-933d-8f3652783ffc None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:52.813854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18005b-1e07-4afe-933d-8f3652783ffc None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:52.813854 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18005b-1e07-4afe-933d-8f3652783ffc None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:52.815330 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 614/1233] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:50:52.821547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b648e-2a3c-4834-b07c-97edcc1a5efd None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:52.822071 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b648e-2a3c-4834-b07c-97edcc1a5efd None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:52.822293 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b648e-2a3c-4834-b07c-97edcc1a5efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:52.839634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-e96b648e-2a3c-4834-b07c-97edcc1a5efd None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:50:52.840811 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-e96b648e-2a3c-4834-b07c-97edcc1a5efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:50:52.910942 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 620/1234] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:50:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:50:52.934261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18005b-1e07-4afe-933d-8f3652783ffc None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:53.037223 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18005b-1e07-4afe-933d-8f3652783ffc None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:53.073716 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f502d5-79d5-4d75-a6da-d6ff12ae2fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:53.074467 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f502d5-79d5-4d75-a6da-d6ff12ae2fa0 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:53.074744 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f502d5-79d5-4d75-a6da-d6ff12ae2fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:53.075012 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f502d5-79d5-4d75-a6da-d6ff12ae2fa0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:53.085402 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f502d5-79d5-4d75-a6da-d6ff12ae2fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:50:53.096831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-d5f502d5-79d5-4d75-a6da-d6ff12ae2fa0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 09:50:53.096831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:53.096831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:53.096831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:53.096831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:53.096831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:53.096831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:53.096831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:53.096831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:53.096831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:53.096831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:53.096831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:53.096831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:50:53.096831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:50:53.096831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:50:53.096831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:50:53.098178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:50:53.098178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:50:53.098178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:50:53.098178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:50:53.098178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:53.098178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:53.098178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:53.098178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:53.098178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:53.098178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:53.098178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:53.098178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:50:53.098178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:53.098178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:53.098178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:53.098178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:53.099595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:53.099595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:53.099595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:53.099595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:53.099595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:50:53.099595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:50:53.099595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:50:53.099595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:50:53.099595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:50:53.099595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:50:53.099595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 09:50:53.099595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:50:53.099595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 615/1235] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 3 09:50:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:53.104748 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b648e-2a3c-4834-b07c-97edcc1a5efd None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:53.214467 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b648e-2a3c-4834-b07c-97edcc1a5efd None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:53.251422 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69540ee7-1ae6-425d-a62f-bd29181220c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:53.252254 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69540ee7-1ae6-425d-a62f-bd29181220c9 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:53.252559 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69540ee7-1ae6-425d-a62f-bd29181220c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:53.252830 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69540ee7-1ae6-425d-a62f-bd29181220c9 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:53.253707 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69540ee7-1ae6-425d-a62f-bd29181220c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:53.254042 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69540ee7-1ae6-425d-a62f-bd29181220c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:53.255701 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69540ee7-1ae6-425d-a62f-bd29181220c9 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:53.265900 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 621/1236] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 3 09:50:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:53.271979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f502d5-79d5-4d75-a6da-d6ff12ae2fa0 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:53.376669 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f502d5-79d5-4d75-a6da-d6ff12ae2fa0 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:53.413156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ab56d-6394-45e6-b7a0-164ecb904b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:53.414199 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ab56d-6394-45e6-b7a0-164ecb904b41 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:53.414476 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ab56d-6394-45e6-b7a0-164ecb904b41 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:53.414745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ab56d-6394-45e6-b7a0-164ecb904b41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:53.426662 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ab56d-6394-45e6-b7a0-164ecb904b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:53.428157 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ab56d-6394-45e6-b7a0-164ecb904b41 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:53.445673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-f74ab56d-6394-45e6-b7a0-164ecb904b41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:53.445673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:53.445673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:53.445673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:53.445673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:53.445673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:53.445673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:53.445673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:53.445673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:53.445673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:53.445673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:53.445673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:53.445673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:50:53.445673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:50:53.445673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:50:53.446953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:50:53.446953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:53.446953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:53.446953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:53.446953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:53.446953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:53.446953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:53.446953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:53.446953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:50:53.446953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:53.446953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:53.446953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:53.446953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:53.446953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:53.446953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:53.446953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:53.446953 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:53.448362 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:50:53.448362 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:50:53.448362 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:53.448362 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:50:53.448362 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 616/1237] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:53.453003 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69540ee7-1ae6-425d-a62f-bd29181220c9 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:53.555652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69540ee7-1ae6-425d-a62f-bd29181220c9 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:53.591800 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaeebe-0f95-48de-9bd9-83ed09b7bdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:53.592615 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaeebe-0f95-48de-9bd9-83ed09b7bdce None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:53.592897 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaeebe-0f95-48de-9bd9-83ed09b7bdce None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:53.593234 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaeebe-0f95-48de-9bd9-83ed09b7bdce None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:53.594346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcaeebe-0f95-48de-9bd9-83ed09b7bdce None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:53.594772 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcaeebe-0f95-48de-9bd9-83ed09b7bdce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:53.596503 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcaeebe-0f95-48de-9bd9-83ed09b7bdce None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:53.615992 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 622/1238] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:53.617259 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ab56d-6394-45e6-b7a0-164ecb904b41 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:53.717569 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ab56d-6394-45e6-b7a0-164ecb904b41 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:53.752990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfa193-4836-4a17-932b-d34fc4138b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:53.753935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfa193-4836-4a17-932b-d34fc4138b5c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:53.754213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfa193-4836-4a17-932b-d34fc4138b5c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:53.754503 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfa193-4836-4a17-932b-d34fc4138b5c None admin] PATH_INFO: `/v3/users/placement` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:53.764227 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfa193-4836-4a17-932b-d34fc4138b5c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:53.765684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfa193-4836-4a17-932b-d34fc4138b5c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:53.783920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-98cfa193-4836-4a17-932b-d34fc4138b5c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 09:50:53.783920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:53.783920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:53.783920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:53.783920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:53.783920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:53.783920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:53.783920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:53.783920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:53.783920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:53.783920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:53.783920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:53.783920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:50:53.783920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:50:53.783920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:50:53.783920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:53.785058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:53.786508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:53.786508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:53.786508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:50:53.786508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:50:53.786508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:50:53.786508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:50:53.786508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:50:53.786508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:50:53.786508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 09:50:53.786508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:50:53.786508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 617/1239] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:50:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:50:53.793592 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaeebe-0f95-48de-9bd9-83ed09b7bdce None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:53.906670 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaeebe-0f95-48de-9bd9-83ed09b7bdce None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:53.939500 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba778a-25d6-4f54-8cd0-50d67d5c501f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:53.940173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba778a-25d6-4f54-8cd0-50d67d5c501f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:53.940462 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba778a-25d6-4f54-8cd0-50d67d5c501f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:53.940717 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba778a-25d6-4f54-8cd0-50d67d5c501f None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:53.941573 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba778a-25d6-4f54-8cd0-50d67d5c501f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:53.941896 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba778a-25d6-4f54-8cd0-50d67d5c501f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:53.943324 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba778a-25d6-4f54-8cd0-50d67d5c501f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:53.962630 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 623/1240] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 3 09:50:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:53.968790 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfa193-4836-4a17-932b-d34fc4138b5c None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:54.079257 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfa193-4836-4a17-932b-d34fc4138b5c None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:54.114724 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b419bd1-e831-4695-a591-bbaa9c5872f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:54.115379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419bd1-e831-4695-a591-bbaa9c5872f7 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:54.115693 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419bd1-e831-4695-a591-bbaa9c5872f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:54.115936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419bd1-e831-4695-a591-bbaa9c5872f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:54.188323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b419bd1-e831-4695-a591-bbaa9c5872f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:54.189781 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b419bd1-e831-4695-a591-bbaa9c5872f7 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:54.289749 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 618/1241] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:50:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 09:50:54.295952 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba778a-25d6-4f54-8cd0-50d67d5c501f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:54.394133 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba778a-25d6-4f54-8cd0-50d67d5c501f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:54.429058 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560be2b-945c-46e9-911b-2b1f2d4f5b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:54.429961 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560be2b-945c-46e9-911b-2b1f2d4f5b36 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:54.430239 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560be2b-945c-46e9-911b-2b1f2d4f5b36 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:54.430506 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560be2b-945c-46e9-911b-2b1f2d4f5b36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:54.440543 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560be2b-945c-46e9-911b-2b1f2d4f5b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:54.442024 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560be2b-945c-46e9-911b-2b1f2d4f5b36 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:54.460143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-8560be2b-945c-46e9-911b-2b1f2d4f5b36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:54.460143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:54.460143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:54.460143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:54.460143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:54.460143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:54.460143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:54.460143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:54.460143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:54.460143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:54.460143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:54.460143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:54.460143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:50:54.460143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:50:54.460143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:50:54.461346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:50:54.461346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:54.461346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:54.461346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:54.461346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:54.461346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:54.461346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:54.461346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:54.461346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:50:54.461346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:54.461346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:54.461346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:54.461346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:54.461346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:54.461346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:54.461346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:54.461346 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:54.462305 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:50:54.462305 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:50:54.462305 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:54.462305 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:50:54.462305 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 624/1242] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:54.468260 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b419bd1-e831-4695-a591-bbaa9c5872f7 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:54.581588 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b419bd1-e831-4695-a591-bbaa9c5872f7 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:54.617261 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f237c5-ab7e-4cca-b756-71b776eadeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:54.617986 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f237c5-ab7e-4cca-b756-71b776eadeb8 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:54.618272 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f237c5-ab7e-4cca-b756-71b776eadeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:54.618546 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f237c5-ab7e-4cca-b756-71b776eadeb8 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:54.619267 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f237c5-ab7e-4cca-b756-71b776eadeb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:54.619569 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f237c5-ab7e-4cca-b756-71b776eadeb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:54.620946 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f237c5-ab7e-4cca-b756-71b776eadeb8 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:54.637783 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 619/1243] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:54.639016 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560be2b-945c-46e9-911b-2b1f2d4f5b36 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:54.742287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560be2b-945c-46e9-911b-2b1f2d4f5b36 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:54.782515 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d634a-dc29-467d-ba7f-82029601446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:54.783334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d634a-dc29-467d-ba7f-82029601446a None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:54.783692 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d634a-dc29-467d-ba7f-82029601446a None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:54.783906 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d634a-dc29-467d-ba7f-82029601446a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:54.790720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d634a-dc29-467d-ba7f-82029601446a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:54.792175 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d634a-dc29-467d-ba7f-82029601446a None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:54.807352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-7c5d634a-dc29-467d-ba7f-82029601446a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:50:54.807352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:54.807352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:54.807352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:54.807352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:54.807352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:54.807352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:54.807352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:54.807352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:54.807352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:54.807352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:54.807352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:54.807352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:50:54.807352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:50:54.807352 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:50:54.809006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:50:54.809006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:54.809006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:54.809006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:54.809006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:54.809006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:54.809006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:54.809006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:54.809006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:50:54.809006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:54.809006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:54.809006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:54.809006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:54.809006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:54.809006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:54.809006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:54.809006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:54.810027 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:50:54.810027 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:50:54.810027 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:50:54.810027 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:50:54.810027 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:50:54.810027 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:50:54.810027 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:50:54.810027 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:50:54.810027 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 625/1244] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:50:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:54.814882 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f237c5-ab7e-4cca-b756-71b776eadeb8 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:54.914332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f237c5-ab7e-4cca-b756-71b776eadeb8 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:54.949065 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66263b3-fd5b-4550-8846-e88eee499028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:54.949924 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66263b3-fd5b-4550-8846-e88eee499028 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:54.950278 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66263b3-fd5b-4550-8846-e88eee499028 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:54.950552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66263b3-fd5b-4550-8846-e88eee499028 None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:54.951672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66263b3-fd5b-4550-8846-e88eee499028 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:54.952060 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66263b3-fd5b-4550-8846-e88eee499028 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:54.954422 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66263b3-fd5b-4550-8846-e88eee499028 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:54.969470 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 620/1245] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:50:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:54.975641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d634a-dc29-467d-ba7f-82029601446a None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:55.080099 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d634a-dc29-467d-ba7f-82029601446a None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:55.117077 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021a8c2-8ada-4326-8e0f-0a5268320a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:55.118050 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021a8c2-8ada-4326-8e0f-0a5268320a4a None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:55.118396 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021a8c2-8ada-4326-8e0f-0a5268320a4a None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:55.118726 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021a8c2-8ada-4326-8e0f-0a5268320a4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:55.119790 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021a8c2-8ada-4326-8e0f-0a5268320a4a None admin] RBAC: Adding query filter params (role.id=779b01e1e2534bfba9971e7000b7c628, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=26bee0f9d8c341fca8290b2fbc95e1e8) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:55.120103 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021a8c2-8ada-4326-8e0f-0a5268320a4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:55.121570 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021a8c2-8ada-4326-8e0f-0a5268320a4a None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:55.128137 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 626/1246] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:50:54 2022] GET /identity/v3/role_assignments?user.id=26bee0f9d8c341fca8290b2fbc95e1e8&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=779b01e1e2534bfba9971e7000b7c628 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:57.405142 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba90212-908c-4482-a63c-823ba1db233f None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:57.406357 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba90212-908c-4482-a63c-823ba1db233f None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:57.406357 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba90212-908c-4482-a63c-823ba1db233f None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:57.407469 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 621/1247] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:50:57.413428 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9eb99c-7ff8-4a08-b3d6-c6f9b4a6ecbe None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:57.414175 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9eb99c-7ff8-4a08-b3d6-c6f9b4a6ecbe None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:57.414738 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9eb99c-7ff8-4a08-b3d6-c6f9b4a6ecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:57.435430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-4a9eb99c-7ff8-4a08-b3d6-c6f9b4a6ecbe None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:50:57.436837 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-4a9eb99c-7ff8-4a08-b3d6-c6f9b4a6ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:50:57.509961 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 627/1248] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:50:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:50:57.534130 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba90212-908c-4482-a63c-823ba1db233f None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:57.644680 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba90212-908c-4482-a63c-823ba1db233f None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:57.679707 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf91ede-6121-41d7-b76e-5722145d45bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:57.680741 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf91ede-6121-41d7-b76e-5722145d45bd None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:57.681048 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf91ede-6121-41d7-b76e-5722145d45bd None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:57.681345 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf91ede-6121-41d7-b76e-5722145d45bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:57.691570 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf91ede-6121-41d7-b76e-5722145d45bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:50:57.699403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-4bf91ede-6121-41d7-b76e-5722145d45bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:50:57.699403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:57.699403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:57.699403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:57.699403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:57.699403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:57.699403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:57.699403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:57.699403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:57.699403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:57.699403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:57.699403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:57.699403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:50:57.699403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:50:57.699403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:50:57.699403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:50:57.700734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:50:57.700734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:50:57.700734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:50:57.700734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:50:57.700734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:57.700734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:57.700734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:57.700734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:57.700734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:57.700734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:57.700734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:57.700734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:50:57.700734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:57.700734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:57.700734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:57.700734 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:57.702135 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:57.702135 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:57.702135 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:57.702135 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:57.702135 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:50:57.702135 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:50:57.702135 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:50:57.702135 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:50:57.702135 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:50:57.702135 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:50:57.702135 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:50:57.702135 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:50:57.702135 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 622/1249] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:50:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:57.706698 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9eb99c-7ff8-4a08-b3d6-c6f9b4a6ecbe None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:57.809768 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9eb99c-7ff8-4a08-b3d6-c6f9b4a6ecbe None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:57.843215 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005b5be-1c30-42bc-9399-28a7d5d0f40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:57.843888 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005b5be-1c30-42bc-9399-28a7d5d0f40b None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:57.844174 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005b5be-1c30-42bc-9399-28a7d5d0f40b None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:57.844449 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005b5be-1c30-42bc-9399-28a7d5d0f40b None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:57.845198 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005b5be-1c30-42bc-9399-28a7d5d0f40b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:57.845512 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005b5be-1c30-42bc-9399-28a7d5d0f40b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:57.846908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005b5be-1c30-42bc-9399-28a7d5d0f40b None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:57.855563 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 628/1250] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:50:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:50:57.861336 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf91ede-6121-41d7-b76e-5722145d45bd None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:57.963988 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf91ede-6121-41d7-b76e-5722145d45bd None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:57.999161 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c592093-7a52-4b5e-9d35-0c97c07ba5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:58.000293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c592093-7a52-4b5e-9d35-0c97c07ba5d9 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:58.000558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c592093-7a52-4b5e-9d35-0c97c07ba5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:58.000887 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c592093-7a52-4b5e-9d35-0c97c07ba5d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:58.014057 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c592093-7a52-4b5e-9d35-0c97c07ba5d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:58.015754 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c592093-7a52-4b5e-9d35-0c97c07ba5d9 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:58.038966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-0c592093-7a52-4b5e-9d35-0c97c07ba5d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:58.038966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:58.038966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:58.038966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:58.038966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:58.038966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:58.038966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:58.038966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:58.038966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:58.038966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:58.038966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:58.038966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:58.038966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:50:58.038966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:50:58.038966 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:50:58.040115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:50:58.040115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:58.040115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:58.040115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:58.040115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:58.040115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:58.040115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:58.040115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:58.040115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:50:58.040115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:58.040115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:58.040115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:58.040115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:58.040115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:58.040115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:58.040115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:58.040115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:58.041302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:50:58.041302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:50:58.041302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:58.041302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:50:58.041302 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 623/1251] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:58.047593 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005b5be-1c30-42bc-9399-28a7d5d0f40b None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:58.162253 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005b5be-1c30-42bc-9399-28a7d5d0f40b None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:58.196818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf55700-6b11-43b4-9d66-8ef04d3f3fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:58.197484 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf55700-6b11-43b4-9d66-8ef04d3f3fce None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:58.197753 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf55700-6b11-43b4-9d66-8ef04d3f3fce None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:58.198055 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf55700-6b11-43b4-9d66-8ef04d3f3fce None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:58.198770 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf55700-6b11-43b4-9d66-8ef04d3f3fce None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:58.199064 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf55700-6b11-43b4-9d66-8ef04d3f3fce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:58.200419 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf55700-6b11-43b4-9d66-8ef04d3f3fce None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:58.212014 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 629/1252] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:58.217737 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c592093-7a52-4b5e-9d35-0c97c07ba5d9 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:58.323070 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c592093-7a52-4b5e-9d35-0c97c07ba5d9 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:58.359122 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907f96e-d391-4a70-b3a2-44cd6819eedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:58.359934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907f96e-d391-4a70-b3a2-44cd6819eedb None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:58.360208 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907f96e-d391-4a70-b3a2-44cd6819eedb None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:58.360473 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907f96e-d391-4a70-b3a2-44cd6819eedb None admin] PATH_INFO: `/v3/users/placement` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:58.369347 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907f96e-d391-4a70-b3a2-44cd6819eedb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:58.371027 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907f96e-d391-4a70-b3a2-44cd6819eedb None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:58.386393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-a907f96e-d391-4a70-b3a2-44cd6819eedb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 09:50:58.386393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:58.386393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:58.386393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:58.386393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:58.386393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:58.386393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:58.386393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:58.386393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:58.386393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:58.386393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:58.386393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:58.386393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:50:58.386393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:50:58.386393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:50:58.386393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:58.387943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:58.388936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:58.388936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:58.388936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:50:58.388936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:50:58.388936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:50:58.388936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:50:58.388936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:50:58.388936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:50:58.388936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 09:50:58.388936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:50:58.388936 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 624/1253] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:50:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:58.394093 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf55700-6b11-43b4-9d66-8ef04d3f3fce None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:58.494633 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf55700-6b11-43b4-9d66-8ef04d3f3fce None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:58.528048 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88778192-e437-4003-96bd-42109a516c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:58.528741 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88778192-e437-4003-96bd-42109a516c5f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:58.529037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88778192-e437-4003-96bd-42109a516c5f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:58.529298 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88778192-e437-4003-96bd-42109a516c5f None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:58.530163 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88778192-e437-4003-96bd-42109a516c5f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:58.530469 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88778192-e437-4003-96bd-42109a516c5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:58.531897 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88778192-e437-4003-96bd-42109a516c5f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:58.548740 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 630/1254] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 3 09:50:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:58.554892 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907f96e-d391-4a70-b3a2-44cd6819eedb None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:58.658497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907f96e-d391-4a70-b3a2-44cd6819eedb None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:58.693234 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a78fcb-3044-46b0-a19c-e70eaafcc36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:58.693919 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a78fcb-3044-46b0-a19c-e70eaafcc36e None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:58.694196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a78fcb-3044-46b0-a19c-e70eaafcc36e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:58.694465 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a78fcb-3044-46b0-a19c-e70eaafcc36e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:58.776987 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a78fcb-3044-46b0-a19c-e70eaafcc36e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:58.779163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a78fcb-3044-46b0-a19c-e70eaafcc36e None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:58.889738 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 625/1255] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:50:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:50:58.895916 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88778192-e437-4003-96bd-42109a516c5f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:59.002050 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88778192-e437-4003-96bd-42109a516c5f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:59.040621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1785d2-434b-45b0-936b-d1576cd42f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:59.041326 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1785d2-434b-45b0-936b-d1576cd42f01 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:59.041600 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1785d2-434b-45b0-936b-d1576cd42f01 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:59.041898 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1785d2-434b-45b0-936b-d1576cd42f01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:59.052707 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1785d2-434b-45b0-936b-d1576cd42f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:59.054210 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1785d2-434b-45b0-936b-d1576cd42f01 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:59.073142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-ad1785d2-434b-45b0-936b-d1576cd42f01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:59.073142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:59.073142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:59.073142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:59.073142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:59.073142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:59.073142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:59.073142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:59.073142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:59.073142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:59.073142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:59.073142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:59.073142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:50:59.073142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:50:59.073142 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:50:59.074299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:50:59.074299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:59.074299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:59.074299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:59.074299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:59.074299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:59.074299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:59.074299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:59.074299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:50:59.074299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:59.074299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:59.074299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:59.074299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:59.074299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:59.074299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:59.074299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:59.074299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:59.075291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:50:59.075291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:50:59.075291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:50:59.075291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:50:59.075291 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 631/1256] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:59.080304 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a78fcb-3044-46b0-a19c-e70eaafcc36e None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:59.185741 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a78fcb-3044-46b0-a19c-e70eaafcc36e None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:59.227695 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab68c7-34cc-47b7-9b1a-18e5a48ab3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:59.228394 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab68c7-34cc-47b7-9b1a-18e5a48ab3e5 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:59.228675 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab68c7-34cc-47b7-9b1a-18e5a48ab3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:59.228969 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab68c7-34cc-47b7-9b1a-18e5a48ab3e5 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:59.229707 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab68c7-34cc-47b7-9b1a-18e5a48ab3e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:59.230043 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab68c7-34cc-47b7-9b1a-18e5a48ab3e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:59.231435 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab68c7-34cc-47b7-9b1a-18e5a48ab3e5 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:59.244361 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 626/1257] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:50:59.250329 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1785d2-434b-45b0-936b-d1576cd42f01 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:59.357621 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1785d2-434b-45b0-936b-d1576cd42f01 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:59.391585 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7aabb-a182-4d65-91cd-9b6210c07dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:59.392401 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7aabb-a182-4d65-91cd-9b6210c07dff None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:59.392675 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7aabb-a182-4d65-91cd-9b6210c07dff None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:59.392960 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7aabb-a182-4d65-91cd-9b6210c07dff None admin] PATH_INFO: `/v3/projects/service` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:59.399515 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7aabb-a182-4d65-91cd-9b6210c07dff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:59.400995 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7aabb-a182-4d65-91cd-9b6210c07dff None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:59.414645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-26d7aabb-a182-4d65-91cd-9b6210c07dff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:50:59.414645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:50:59.414645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:50:59.414645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:50:59.414645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:50:59.414645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:50:59.414645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:50:59.414645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:50:59.414645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:50:59.414645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:50:59.414645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:50:59.414645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:50:59.414645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:50:59.414645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:50:59.414645 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:50:59.415681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:50:59.415681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:50:59.415681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:50:59.415681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:50:59.415681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:50:59.415681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:50:59.415681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:50:59.415681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:50:59.415681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:50:59.415681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:50:59.415681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:50:59.415681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:50:59.415681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:50:59.415681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:50:59.415681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:50:59.415681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:50:59.415681 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:50:59.416638 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:50:59.416638 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:50:59.416638 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:50:59.416638 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:50:59.416638 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:50:59.416638 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:50:59.416638 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:50:59.416638 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:50:59.416638 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 632/1258] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:50:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:50:59.422136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab68c7-34cc-47b7-9b1a-18e5a48ab3e5 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:59.519741 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab68c7-34cc-47b7-9b1a-18e5a48ab3e5 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:59.566004 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57665e6-449a-4524-9d9b-ee9af29cae04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:59.566663 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57665e6-449a-4524-9d9b-ee9af29cae04 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:59.566944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57665e6-449a-4524-9d9b-ee9af29cae04 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:59.567227 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57665e6-449a-4524-9d9b-ee9af29cae04 None admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:59.568020 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57665e6-449a-4524-9d9b-ee9af29cae04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:59.568323 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57665e6-449a-4524-9d9b-ee9af29cae04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:59.569748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57665e6-449a-4524-9d9b-ee9af29cae04 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:59.582014 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 627/1259] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:50:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:50:59.588415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7aabb-a182-4d65-91cd-9b6210c07dff None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:50:59.686578 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7aabb-a182-4d65-91cd-9b6210c07dff None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:50:59.719545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba135a34-7102-4bbf-ba9f-7f24bd932250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:50:59.720180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba135a34-7102-4bbf-ba9f-7f24bd932250 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:50:59.720451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba135a34-7102-4bbf-ba9f-7f24bd932250 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:50:59.720720 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba135a34-7102-4bbf-ba9f-7f24bd932250 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:50:59.721841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba135a34-7102-4bbf-ba9f-7f24bd932250 None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=26bee0f9d8c341fca8290b2fbc95e1e8) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:50:59.722138 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba135a34-7102-4bbf-ba9f-7f24bd932250 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:50:59.723550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba135a34-7102-4bbf-ba9f-7f24bd932250 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:50:59.729184 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 633/1260] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:50:59 2022] GET /identity/v3/role_assignments?user.id=26bee0f9d8c341fca8290b2fbc95e1e8&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=52d3ad3e32c741938997691c9a909b81 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:51:01.942457 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02601e7-7833-4f66-9f16-183e29bfdcfb None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:01.943055 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02601e7-7833-4f66-9f16-183e29bfdcfb None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:01.943284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02601e7-7833-4f66-9f16-183e29bfdcfb None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:01.944781 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 628/1261] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:51:01.951820 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c466d-c23a-4d65-a512-bf71902c7458 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:01.952543 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c466d-c23a-4d65-a512-bf71902c7458 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:01.952703 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c466d-c23a-4d65-a512-bf71902c7458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:01.975178 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-8c4c466d-c23a-4d65-a512-bf71902c7458 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:51:01.976565 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-8c4c466d-c23a-4d65-a512-bf71902c7458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:51:02.048625 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 634/1262] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:51:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:51:02.071836 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02601e7-7833-4f66-9f16-183e29bfdcfb None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:02.172555 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02601e7-7833-4f66-9f16-183e29bfdcfb None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:02.206938 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f55ba-cbb9-4138-abd6-7e893e74c2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:02.207648 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f55ba-cbb9-4138-abd6-7e893e74c2a6 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:02.207924 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f55ba-cbb9-4138-abd6-7e893e74c2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:02.208195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f55ba-cbb9-4138-abd6-7e893e74c2a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:02.218112 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f55ba-cbb9-4138-abd6-7e893e74c2a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:51:02.225650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-003f55ba-cbb9-4138-abd6-7e893e74c2a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:51:02.225650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:51:02.225650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:51:02.225650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:51:02.225650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:51:02.225650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:51:02.225650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:51:02.225650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:51:02.225650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:51:02.225650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:51:02.225650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:51:02.225650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:51:02.225650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:51:02.225650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:51:02.225650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:51:02.225650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:51:02.226759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:51:02.226759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:51:02.226759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:51:02.226759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:51:02.226759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:51:02.226759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:51:02.226759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:51:02.226759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:51:02.226759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:51:02.226759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:51:02.226759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:51:02.226759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:51:02.226759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:51:02.226759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:51:02.226759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:51:02.226759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:51:02.227831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:51:02.227831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:51:02.227831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:51:02.227831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:51:02.227831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:51:02.227831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:51:02.227831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:51:02.227831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:51:02.227831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:51:02.227831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:51:02.227831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:51:02.227831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:51:02.229972 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 629/1263] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:51:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:51:02.233653 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c466d-c23a-4d65-a512-bf71902c7458 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:02.344687 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c466d-c23a-4d65-a512-bf71902c7458 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:02.378888 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8885d-1a23-412d-878a-e87e0eafbad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:02.379547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8885d-1a23-412d-878a-e87e0eafbad4 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:02.379827 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8885d-1a23-412d-878a-e87e0eafbad4 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:02.380094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8885d-1a23-412d-878a-e87e0eafbad4 None admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:02.380849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8885d-1a23-412d-878a-e87e0eafbad4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:51:02.381146 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8885d-1a23-412d-878a-e87e0eafbad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:02.382548 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8885d-1a23-412d-878a-e87e0eafbad4 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:02.391653 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 635/1264] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:51:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:51:02.401022 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f55ba-cbb9-4138-abd6-7e893e74c2a6 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:02.505292 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f55ba-cbb9-4138-abd6-7e893e74c2a6 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:02.538289 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f13dd-83f9-4b3d-9e44-239a162ca306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:02.539105 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f13dd-83f9-4b3d-9e44-239a162ca306 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:02.539393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f13dd-83f9-4b3d-9e44-239a162ca306 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:02.539640 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f13dd-83f9-4b3d-9e44-239a162ca306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:02.549696 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f13dd-83f9-4b3d-9e44-239a162ca306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:02.551187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f13dd-83f9-4b3d-9e44-239a162ca306 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:02.572889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-3b1f13dd-83f9-4b3d-9e44-239a162ca306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:51:02.572889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:51:02.572889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:51:02.572889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:51:02.572889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:51:02.572889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:51:02.572889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:51:02.572889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:51:02.572889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:51:02.572889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:51:02.572889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:51:02.572889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:51:02.572889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:51:02.572889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:51:02.572889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:51:02.573992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:51:02.573992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:51:02.573992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:51:02.573992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:51:02.573992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:51:02.573992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:51:02.573992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:51:02.573992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:51:02.573992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:51:02.573992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:51:02.573992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:51:02.573992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:51:02.573992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:51:02.573992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:51:02.573992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:51:02.573992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:51:02.573992 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:51:02.575177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:51:02.575177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:51:02.575177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:51:02.575177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:51:02.575177 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 630/1265] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:51:02.583029 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8885d-1a23-412d-878a-e87e0eafbad4 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:02.679647 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8885d-1a23-412d-878a-e87e0eafbad4 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:02.711550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bffbf-69ec-486c-98ea-898a8e94ab9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:02.712198 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bffbf-69ec-486c-98ea-898a8e94ab9f None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:02.712475 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bffbf-69ec-486c-98ea-898a8e94ab9f None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:02.712745 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bffbf-69ec-486c-98ea-898a8e94ab9f None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:02.713450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bffbf-69ec-486c-98ea-898a8e94ab9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:51:02.713756 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bffbf-69ec-486c-98ea-898a8e94ab9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:02.715143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bffbf-69ec-486c-98ea-898a8e94ab9f None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:02.726603 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 636/1266] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:51:02.732641 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f13dd-83f9-4b3d-9e44-239a162ca306 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:02.845911 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f13dd-83f9-4b3d-9e44-239a162ca306 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:02.889666 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99149a43-4500-4c4c-a091-dc1b9ec1ddd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:02.890497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99149a43-4500-4c4c-a091-dc1b9ec1ddd3 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:02.890778 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99149a43-4500-4c4c-a091-dc1b9ec1ddd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:02.891051 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99149a43-4500-4c4c-a091-dc1b9ec1ddd3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:02.900068 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99149a43-4500-4c4c-a091-dc1b9ec1ddd3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:02.901534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99149a43-4500-4c4c-a091-dc1b9ec1ddd3 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:02.916961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-99149a43-4500-4c4c-a091-dc1b9ec1ddd3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 09:51:02.916961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:51:02.916961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:51:02.916961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:51:02.916961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:51:02.916961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:51:02.916961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:51:02.916961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:51:02.916961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:51:02.916961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:51:02.916961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:51:02.916961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:51:02.916961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:51:02.916961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:51:02.916961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:51:02.916961 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:51:02.918025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:51:02.919056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:51:02.919056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:51:02.919056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:51:02.919056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:51:02.919056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:51:02.919056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:51:02.919056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:51:02.919056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:51:02.919056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 09:51:02.919056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:51:02.919056 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 631/1267] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:51:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:51:02.926838 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bffbf-69ec-486c-98ea-898a8e94ab9f None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:03.049436 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bffbf-69ec-486c-98ea-898a8e94ab9f None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:03.085312 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeb28a-7738-4684-935d-acbdd54c24a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:03.086130 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeb28a-7738-4684-935d-acbdd54c24a0 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:03.086413 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeb28a-7738-4684-935d-acbdd54c24a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:03.086675 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeb28a-7738-4684-935d-acbdd54c24a0 None admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:03.087501 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeb28a-7738-4684-935d-acbdd54c24a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:51:03.087808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeb28a-7738-4684-935d-acbdd54c24a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:03.089221 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeb28a-7738-4684-935d-acbdd54c24a0 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:03.106325 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 637/1268] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 3 09:51:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:51:03.115400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99149a43-4500-4c4c-a091-dc1b9ec1ddd3 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:03.228358 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99149a43-4500-4c4c-a091-dc1b9ec1ddd3 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:03.267332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cd99c-c839-4a5b-836d-49aceece3eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:03.268124 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cd99c-c839-4a5b-836d-49aceece3eda None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:03.268395 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cd99c-c839-4a5b-836d-49aceece3eda None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:03.268665 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cd99c-c839-4a5b-836d-49aceece3eda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:03.279764 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cd99c-c839-4a5b-836d-49aceece3eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:03.281184 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cd99c-c839-4a5b-836d-49aceece3eda None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:03.299339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-239cd99c-c839-4a5b-836d-49aceece3eda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:51:03.299339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:51:03.299339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:51:03.299339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:51:03.299339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:51:03.299339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:51:03.299339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:51:03.299339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:51:03.299339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:51:03.299339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:51:03.299339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:51:03.299339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:51:03.299339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:51:03.299339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:51:03.299339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:51:03.300434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:51:03.300434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:51:03.300434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:51:03.300434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:51:03.300434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:51:03.300434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:51:03.300434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:51:03.300434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:51:03.300434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:51:03.300434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:51:03.300434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:51:03.300434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:51:03.300434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:51:03.300434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:51:03.300434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:51:03.300434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:51:03.300434 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:51:03.301533 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:51:03.301533 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:51:03.301533 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:51:03.301533 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:51:03.301533 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 632/1269] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:51:03.306662 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeb28a-7738-4684-935d-acbdd54c24a0 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:03.406531 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeb28a-7738-4684-935d-acbdd54c24a0 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:03.439980 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bc548-5f45-4fe8-8195-f04fa0c25e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:03.440632 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bc548-5f45-4fe8-8195-f04fa0c25e89 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:03.440901 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bc548-5f45-4fe8-8195-f04fa0c25e89 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:03.441189 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bc548-5f45-4fe8-8195-f04fa0c25e89 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:03.441928 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bc548-5f45-4fe8-8195-f04fa0c25e89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:51:03.442218 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bc548-5f45-4fe8-8195-f04fa0c25e89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:03.443559 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bc548-5f45-4fe8-8195-f04fa0c25e89 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:03.454380 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 638/1270] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:51:03.460126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cd99c-c839-4a5b-836d-49aceece3eda None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:03.573246 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cd99c-c839-4a5b-836d-49aceece3eda None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:03.606940 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a72026-b41a-4173-9bbe-cc2e129f890d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:03.607722 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a72026-b41a-4173-9bbe-cc2e129f890d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:03.607998 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a72026-b41a-4173-9bbe-cc2e129f890d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:03.608268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a72026-b41a-4173-9bbe-cc2e129f890d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:03.615862 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a72026-b41a-4173-9bbe-cc2e129f890d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:03.617500 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a72026-b41a-4173-9bbe-cc2e129f890d None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:03.633279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-49a72026-b41a-4173-9bbe-cc2e129f890d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:51:03.633279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:51:03.633279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:51:03.633279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:51:03.633279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:51:03.633279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:51:03.633279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:51:03.633279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:51:03.633279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:51:03.633279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:51:03.633279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:51:03.633279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:51:03.633279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:51:03.633279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:51:03.633279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:51:03.634356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:51:03.634356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:51:03.634356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:51:03.634356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:51:03.634356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:51:03.634356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:51:03.634356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:51:03.634356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:51:03.634356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:51:03.634356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:51:03.634356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:51:03.634356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:51:03.634356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:51:03.634356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:51:03.634356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:51:03.634356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:51:03.634356 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:51:03.635728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:51:03.635728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:51:03.635728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:51:03.635728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:51:03.635728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:51:03.635728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:51:03.635728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:51:03.635728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:51:03.635728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 633/1271] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:51:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:51:03.644100 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bc548-5f45-4fe8-8195-f04fa0c25e89 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:03.750800 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bc548-5f45-4fe8-8195-f04fa0c25e89 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:03.788505 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6cb07-a653-4f45-80fd-913cb0000934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:03.789339 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6cb07-a653-4f45-80fd-913cb0000934 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:03.789635 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6cb07-a653-4f45-80fd-913cb0000934 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:03.789903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6cb07-a653-4f45-80fd-913cb0000934 None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:03.790707 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6cb07-a653-4f45-80fd-913cb0000934 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:51:03.791013 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6cb07-a653-4f45-80fd-913cb0000934 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:03.792409 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6cb07-a653-4f45-80fd-913cb0000934 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:03.803981 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 639/1272] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:51:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:51:03.813304 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a72026-b41a-4173-9bbe-cc2e129f890d None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:03.922223 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a72026-b41a-4173-9bbe-cc2e129f890d None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:03.955168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b080c1d-eeef-4bf1-a2a6-b4358ebce5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:03.956033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b080c1d-eeef-4bf1-a2a6-b4358ebce5f2 None admin] REQUEST_METHOD: `PUT` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:03.956304 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b080c1d-eeef-4bf1-a2a6-b4358ebce5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:03.956570 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b080c1d-eeef-4bf1-a2a6-b4358ebce5f2 None admin] PATH_INFO: `/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/26bee0f9d8c341fca8290b2fbc95e1e8/roles/52d3ad3e32c741938997691c9a909b81` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:03.958737 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b080c1d-eeef-4bf1-a2a6-b4358ebce5f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f395f4842c39422d962dbddc4cf2897a, user_id=26bee0f9d8c341fca8290b2fbc95e1e8, role_id=52d3ad3e32c741938997691c9a909b81)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:03.960156 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b080c1d-eeef-4bf1-a2a6-b4358ebce5f2 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:03.976679 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 634/1273] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 3 09:51:03 2022] PUT /identity/v3/projects/f395f4842c39422d962dbddc4cf2897a/users/26bee0f9d8c341fca8290b2fbc95e1e8/roles/52d3ad3e32c741938997691c9a909b81 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:51:06.148255 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6059be9-52c1-4894-959a-257b14d1e94b None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:06.149106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6059be9-52c1-4894-959a-257b14d1e94b None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:06.149106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6059be9-52c1-4894-959a-257b14d1e94b None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:06.151270 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 640/1274] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:51:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:51:06.157489 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a1d51-f0ca-478a-b229-1850b89f000e None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:06.158252 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a1d51-f0ca-478a-b229-1850b89f000e None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:06.158396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a1d51-f0ca-478a-b229-1850b89f000e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:06.178115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-ee4a1d51-f0ca-478a-b229-1850b89f000e None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:51:06.179282 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-ee4a1d51-f0ca-478a-b229-1850b89f000e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:51:06.247269 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 635/1275] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:51:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:51:06.271379 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6059be9-52c1-4894-959a-257b14d1e94b None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:06.377894 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6059be9-52c1-4894-959a-257b14d1e94b None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:06.412203 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29e314-04d9-4976-aa80-70f863a35d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:06.412952 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29e314-04d9-4976-aa80-70f863a35d5e None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:06.413236 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29e314-04d9-4976-aa80-70f863a35d5e None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:06.413504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29e314-04d9-4976-aa80-70f863a35d5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:06.424367 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29e314-04d9-4976-aa80-70f863a35d5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 09:51:06.432415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-cb29e314-04d9-4976-aa80-70f863a35d5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:51:06.432415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:51:06.432415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:51:06.432415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:51:06.432415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:51:06.432415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:51:06.432415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:51:06.432415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:51:06.432415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:51:06.432415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:51:06.432415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:51:06.432415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:51:06.432415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 09:51:06.432415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 09:51:06.432415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 09:51:06.432415 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 09:51:06.433483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 09:51:06.433483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 09:51:06.433483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 09:51:06.433483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 09:51:06.433483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:51:06.433483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:51:06.433483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:51:06.433483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:51:06.433483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:51:06.433483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:51:06.433483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:51:06.433483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:51:06.433483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:51:06.433483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:51:06.433483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:51:06.433483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:51:06.434499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:51:06.434499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:51:06.434499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:51:06.434499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:51:06.434499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 09:51:06.434499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 09:51:06.434499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 09:51:06.434499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 09:51:06.434499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 09:51:06.434499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 09:51:06.434499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 09:51:06.434499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:51:06.434499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 641/1276] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 3 09:51:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:51:06.441783 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a1d51-f0ca-478a-b229-1850b89f000e None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:06.548620 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a1d51-f0ca-478a-b229-1850b89f000e None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:06.588538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968a5ca-1fe5-4e3a-9910-ed367faace6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:06.589187 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968a5ca-1fe5-4e3a-9910-ed367faace6c None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:06.589745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968a5ca-1fe5-4e3a-9910-ed367faace6c None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:06.590044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968a5ca-1fe5-4e3a-9910-ed367faace6c None admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:06.590780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968a5ca-1fe5-4e3a-9910-ed367faace6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:51:06.591080 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968a5ca-1fe5-4e3a-9910-ed367faace6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:06.592431 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968a5ca-1fe5-4e3a-9910-ed367faace6c None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:06.600370 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 636/1277] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 3 09:51:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:51:06.609118 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29e314-04d9-4976-aa80-70f863a35d5e None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:06.709615 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29e314-04d9-4976-aa80-70f863a35d5e None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:06.742249 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee304f-9b01-4f95-a31b-c4b05ffafde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:06.743011 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee304f-9b01-4f95-a31b-c4b05ffafde8 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:06.743284 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee304f-9b01-4f95-a31b-c4b05ffafde8 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:06.743552 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee304f-9b01-4f95-a31b-c4b05ffafde8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:06.754537 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee304f-9b01-4f95-a31b-c4b05ffafde8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:06.756181 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee304f-9b01-4f95-a31b-c4b05ffafde8 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:06.778540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-0eee304f-9b01-4f95-a31b-c4b05ffafde8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:51:06.778540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:51:06.778540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:51:06.778540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:51:06.778540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:51:06.778540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:51:06.778540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:51:06.778540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:51:06.778540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:51:06.778540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:51:06.778540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:51:06.778540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:51:06.778540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:51:06.778540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:51:06.778540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:51:06.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:51:06.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:51:06.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:51:06.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:51:06.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:51:06.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:51:06.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:51:06.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:51:06.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:51:06.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:51:06.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:51:06.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:51:06.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:51:06.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:51:06.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:51:06.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:51:06.779850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:51:06.781373 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:51:06.781373 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:51:06.781373 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:51:06.781373 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:51:06.781373 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 642/1278] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 09:51:06.788137 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968a5ca-1fe5-4e3a-9910-ed367faace6c None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:06.902901 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968a5ca-1fe5-4e3a-9910-ed367faace6c None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:06.936678 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01aac8c-0478-442e-8d63-8817c2d024b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:06.937318 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aac8c-0478-442e-8d63-8817c2d024b2 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:06.937595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aac8c-0478-442e-8d63-8817c2d024b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:06.937902 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aac8c-0478-442e-8d63-8817c2d024b2 None admin] PATH_INFO: `/v3/domains` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:06.938604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01aac8c-0478-442e-8d63-8817c2d024b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:51:06.938910 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01aac8c-0478-442e-8d63-8817c2d024b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:06.940286 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01aac8c-0478-442e-8d63-8817c2d024b2 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:06.952112 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 637/1279] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:51:06.958105 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee304f-9b01-4f95-a31b-c4b05ffafde8 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:07.071165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee304f-9b01-4f95-a31b-c4b05ffafde8 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:07.111250 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c010dd-252c-497d-8d1f-d59959f13484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:07.112402 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c010dd-252c-497d-8d1f-d59959f13484 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:07.112769 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c010dd-252c-497d-8d1f-d59959f13484 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:07.113118 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c010dd-252c-497d-8d1f-d59959f13484 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:07.122298 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c010dd-252c-497d-8d1f-d59959f13484 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:07.123738 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c010dd-252c-497d-8d1f-d59959f13484 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:07.138337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-45c010dd-252c-497d-8d1f-d59959f13484 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 09:51:07.138337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:51:07.138337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:51:07.138337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:51:07.138337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:51:07.138337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:51:07.138337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:51:07.138337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:51:07.138337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:51:07.138337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:51:07.138337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:51:07.138337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:51:07.138337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 09:51:07.138337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 09:51:07.138337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 09:51:07.138337 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:51:07.139417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:51:07.140565 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:51:07.140565 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:51:07.140565 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 09:51:07.140565 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 09:51:07.140565 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 09:51:07.140565 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 09:51:07.140565 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 09:51:07.140565 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 09:51:07.140565 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 09:51:07.140565 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:51:07.140565 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 643/1280] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:51:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:51:07.147102 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01aac8c-0478-442e-8d63-8817c2d024b2 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:07.246925 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01aac8c-0478-442e-8d63-8817c2d024b2 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:07.281803 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821d260-3a2f-4f8f-bfa5-de6a933fc12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:07.282470 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821d260-3a2f-4f8f-bfa5-de6a933fc12f None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:07.282748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821d260-3a2f-4f8f-bfa5-de6a933fc12f None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:07.283023 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821d260-3a2f-4f8f-bfa5-de6a933fc12f None admin] PATH_INFO: `/v3/users` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:07.283845 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821d260-3a2f-4f8f-bfa5-de6a933fc12f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:51:07.284149 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821d260-3a2f-4f8f-bfa5-de6a933fc12f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:07.285576 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821d260-3a2f-4f8f-bfa5-de6a933fc12f None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:07.303216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 638/1281] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 3 09:51:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:51:07.309776 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c010dd-252c-497d-8d1f-d59959f13484 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:07.414836 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c010dd-252c-497d-8d1f-d59959f13484 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:07.447958 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11acc6-632f-4bf0-91be-bd3dff502917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:07.448579 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11acc6-632f-4bf0-91be-bd3dff502917 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:07.448853 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11acc6-632f-4bf0-91be-bd3dff502917 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:07.449121 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11acc6-632f-4bf0-91be-bd3dff502917 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:07.513919 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11acc6-632f-4bf0-91be-bd3dff502917 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:07.515378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11acc6-632f-4bf0-91be-bd3dff502917 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:07.619881 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 644/1282] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 3 09:51:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 09:51:07.626630 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821d260-3a2f-4f8f-bfa5-de6a933fc12f None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:07.729318 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821d260-3a2f-4f8f-bfa5-de6a933fc12f None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:07.764004 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cc5a8-2f29-49db-a21e-e82970c50023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:07.764804 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cc5a8-2f29-49db-a21e-e82970c50023 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:07.765082 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cc5a8-2f29-49db-a21e-e82970c50023 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:07.765381 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cc5a8-2f29-49db-a21e-e82970c50023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:07.776661 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cc5a8-2f29-49db-a21e-e82970c50023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:07.778146 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cc5a8-2f29-49db-a21e-e82970c50023 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:07.795484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-fd4cc5a8-2f29-49db-a21e-e82970c50023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:51:07.795484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:51:07.795484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:51:07.795484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:51:07.795484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:51:07.795484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:51:07.795484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:51:07.795484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:51:07.795484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:51:07.795484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:51:07.795484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:51:07.795484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:51:07.795484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 09:51:07.795484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 09:51:07.795484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 09:51:07.796552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 09:51:07.796552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:51:07.796552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:51:07.796552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:51:07.796552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:51:07.796552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:51:07.796552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:51:07.796552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:51:07.796552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:51:07.796552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:51:07.796552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:51:07.796552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:51:07.796552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:51:07.796552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:51:07.796552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:51:07.796552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:51:07.796552 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:51:07.797650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 09:51:07.797650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 09:51:07.797650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 09:51:07.797650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:51:07.797650 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 639/1283] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:51:07.802891 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11acc6-632f-4bf0-91be-bd3dff502917 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:07.901639 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11acc6-632f-4bf0-91be-bd3dff502917 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:07.935794 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d8f2b-c994-4327-b8a0-c295a85085a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:07.936426 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d8f2b-c994-4327-b8a0-c295a85085a8 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:07.936702 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d8f2b-c994-4327-b8a0-c295a85085a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:07.936975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d8f2b-c994-4327-b8a0-c295a85085a8 None admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:07.937676 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d8f2b-c994-4327-b8a0-c295a85085a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:51:07.937999 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d8f2b-c994-4327-b8a0-c295a85085a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:07.939344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d8f2b-c994-4327-b8a0-c295a85085a8 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:07.950349 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 645/1284] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 3 09:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:51:07.958766 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cc5a8-2f29-49db-a21e-e82970c50023 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:08.064745 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cc5a8-2f29-49db-a21e-e82970c50023 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:08.098183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8fec4-c45d-4d8f-bfb7-0c9c858be63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:08.098971 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8fec4-c45d-4d8f-bfb7-0c9c858be63a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:08.099243 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8fec4-c45d-4d8f-bfb7-0c9c858be63a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:08.099538 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8fec4-c45d-4d8f-bfb7-0c9c858be63a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:08.106355 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8fec4-c45d-4d8f-bfb7-0c9c858be63a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:08.107794 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8fec4-c45d-4d8f-bfb7-0c9c858be63a None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:08.121466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application [None req-b8a8fec4-c45d-4d8f-bfb7-0c9c858be63a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:51:08.121466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:51:08.121466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:51:08.121466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:51:08.121466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:51:08.121466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:51:08.121466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:51:08.121466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:51:08.121466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:51:08.121466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:51:08.121466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:51:08.121466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:51:08.121466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 09:51:08.121466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 09:51:08.121466 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 09:51:08.122403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 09:51:08.122403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:51:08.122403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:51:08.122403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:51:08.122403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:51:08.122403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:51:08.122403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:51:08.122403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:51:08.122403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application with Lock( May 03 09:51:08.122403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:51:08.122403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._enter() May 03 09:51:08.122403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:51:08.122403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:51:08.122403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:51:08.122403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.creator() May 03 09:51:08.122403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:51:08.122403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application created_value = creator( May 03 09:51:08.123368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 09:51:08.123368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 09:51:08.123368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 09:51:08.123368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 09:51:08.123368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 09:51:08.123368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 09:51:08.123368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 09:51:08.123368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: ERROR keystone.server.flask.application May 03 09:51:08.123368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 640/1285] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 3 09:51:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:51:08.131776 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d8f2b-c994-4327-b8a0-c295a85085a8 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:08.230234 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d8f2b-c994-4327-b8a0-c295a85085a8 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:08.261760 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079b3e9-882d-4ec2-a2b7-7c50d4342dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:08.262456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079b3e9-882d-4ec2-a2b7-7c50d4342dc2 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:08.263060 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079b3e9-882d-4ec2-a2b7-7c50d4342dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:08.263334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079b3e9-882d-4ec2-a2b7-7c50d4342dc2 None admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:08.264120 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079b3e9-882d-4ec2-a2b7-7c50d4342dc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:51:08.264422 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079b3e9-882d-4ec2-a2b7-7c50d4342dc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:08.265885 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079b3e9-882d-4ec2-a2b7-7c50d4342dc2 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:08.277977 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 646/1286] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 3 09:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:51:08.284185 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8fec4-c45d-4d8f-bfb7-0c9c858be63a None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:08.379677 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8fec4-c45d-4d8f-bfb7-0c9c858be63a None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:08.410709 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea5e5a-3971-4a7b-a826-d95a2154f95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:08.411347 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea5e5a-3971-4a7b-a826-d95a2154f95d None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:08.411618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea5e5a-3971-4a7b-a826-d95a2154f95d None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:08.411884 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea5e5a-3971-4a7b-a826-d95a2154f95d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:08.412702 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea5e5a-3971-4a7b-a826-d95a2154f95d None admin] RBAC: Adding query filter params (role.id=52d3ad3e32c741938997691c9a909b81, scope.project.id=f395f4842c39422d962dbddc4cf2897a, user.id=26bee0f9d8c341fca8290b2fbc95e1e8) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:51:08.413008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea5e5a-3971-4a7b-a826-d95a2154f95d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:08.414494 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea5e5a-3971-4a7b-a826-d95a2154f95d None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:08.420380 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 641/1287] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 3 09:51:08 2022] GET /identity/v3/role_assignments?user.id=26bee0f9d8c341fca8290b2fbc95e1e8&scope.project.id=f395f4842c39422d962dbddc4cf2897a&role.id=52d3ad3e32c741938997691c9a909b81 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:51:10.672414 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5117e7-bed6-452f-a3ae-7826a722c807 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:10.673243 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5117e7-bed6-452f-a3ae-7826a722c807 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:10.673243 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5117e7-bed6-452f-a3ae-7826a722c807 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:10.675391 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 647/1288] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:51:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:51:10.684665 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb319ac-71fe-44a0-8aab-2b9ce45db529 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:10.685079 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb319ac-71fe-44a0-8aab-2b9ce45db529 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:10.685253 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb319ac-71fe-44a0-8aab-2b9ce45db529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:10.707003 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-9cb319ac-71fe-44a0-8aab-2b9ce45db529 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:51:10.708196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-9cb319ac-71fe-44a0-8aab-2b9ce45db529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:51:10.779264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 642/1289] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:51:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:51:10.805445 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5117e7-bed6-452f-a3ae-7826a722c807 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:10.909476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5117e7-bed6-452f-a3ae-7826a722c807 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:10.944588 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43160-3561-4fe1-8249-5d8b050f7aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:10.945460 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43160-3561-4fe1-8249-5d8b050f7aff None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:10.946179 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43160-3561-4fe1-8249-5d8b050f7aff None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:10.946466 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43160-3561-4fe1-8249-5d8b050f7aff None admin] PATH_INFO: `/v3/services/placement` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:10.947119 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e43160-3561-4fe1-8249-5d8b050f7aff None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:10.948490 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e43160-3561-4fe1-8249-5d8b050f7aff None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:10.960395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-e1e43160-3561-4fe1-8249-5d8b050f7aff None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:51:10.960395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:51:10.960395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:51:10.960395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:51:10.960395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:51:10.960395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:51:10.960395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:51:10.960395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:51:10.960395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:51:10.960395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:51:10.960395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:51:10.960395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:51:10.960395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:51:10.960395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:51:10.960395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:51:10.960395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:51:10.960395 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:51:10.961930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:51:10.961930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:51:10.961930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:51:10.961930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:51:10.961930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:51:10.961930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:51:10.961930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:51:10.961930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:51:10.961930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:51:10.961930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:51:10.961930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:51:10.961930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:51:10.961930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:51:10.961930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:51:10.961930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:51:10.961930 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:51:10.963012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:51:10.963012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:51:10.963012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:51:10.963012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:51:10.963012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:51:10.963012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:51:10.963012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:51:10.963012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:51:10.963012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:51:10.963012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:51:10.963012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:51:10.963012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:51:10.963012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:51:10.963012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:51:10.963012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 648/1290] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 3 09:51:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:51:10.968600 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb319ac-71fe-44a0-8aab-2b9ce45db529 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:11.070378 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb319ac-71fe-44a0-8aab-2b9ce45db529 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:11.105359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72bcfb-744e-47e7-896f-80cdb76a36ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:11.106038 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72bcfb-744e-47e7-896f-80cdb76a36ab None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:11.106319 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72bcfb-744e-47e7-896f-80cdb76a36ab None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:11.106590 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72bcfb-744e-47e7-896f-80cdb76a36ab None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:11.107287 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72bcfb-744e-47e7-896f-80cdb76a36ab None admin] RBAC: Adding query filter params (name=placement) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:51:11.107590 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72bcfb-744e-47e7-896f-80cdb76a36ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:11.108940 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72bcfb-744e-47e7-896f-80cdb76a36ab None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:11.113655 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 643/1291] 10.222.0.55 () {56 vars in 1116 bytes} [Tue May 3 09:51:10 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 09:51:11.119607 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43160-3561-4fe1-8249-5d8b050f7aff None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:11.217550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43160-3561-4fe1-8249-5d8b050f7aff None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:11.250303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cfe7d-bbe1-4450-a8a8-80b49b0201ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:11.250953 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cfe7d-bbe1-4450-a8a8-80b49b0201ab None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:11.251229 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cfe7d-bbe1-4450-a8a8-80b49b0201ab None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:11.251498 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cfe7d-bbe1-4450-a8a8-80b49b0201ab None admin] PATH_INFO: `/v3/services` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:11.252194 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cfe7d-bbe1-4450-a8a8-80b49b0201ab None admin] RBAC: Adding query filter params (type=placement) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:51:11.252494 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cfe7d-bbe1-4450-a8a8-80b49b0201ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:11.253842 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cfe7d-bbe1-4450-a8a8-80b49b0201ab None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:11.259054 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 649/1292] 10.222.0.55 () {56 vars in 1116 bytes} [Tue May 3 09:51:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:51:13.465188 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac4afc-7d34-4c3a-af2f-53d6bdf72c92 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:13.465782 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac4afc-7d34-4c3a-af2f-53d6bdf72c92 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:13.465782 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac4afc-7d34-4c3a-af2f-53d6bdf72c92 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:13.467128 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 644/1293] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:51:13.472400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673e002-1425-4c21-b668-9dadad6b1bd4 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:13.472818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673e002-1425-4c21-b668-9dadad6b1bd4 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:13.472932 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673e002-1425-4c21-b668-9dadad6b1bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:13.491427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-d673e002-1425-4c21-b668-9dadad6b1bd4 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:51:13.492606 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-d673e002-1425-4c21-b668-9dadad6b1bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:51:13.567480 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 650/1294] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:51:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:51:13.591059 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac4afc-7d34-4c3a-af2f-53d6bdf72c92 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:13.694354 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac4afc-7d34-4c3a-af2f-53d6bdf72c92 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:13.728055 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2012b-69e7-4449-b9d5-ef34c494466e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:13.728685 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2012b-69e7-4449-b9d5-ef34c494466e None admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:13.728959 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2012b-69e7-4449-b9d5-ef34c494466e None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:13.729228 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2012b-69e7-4449-b9d5-ef34c494466e None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:13.730061 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2012b-69e7-4449-b9d5-ef34c494466e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:13.731417 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2012b-69e7-4449-b9d5-ef34c494466e None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:13.747405 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 645/1295] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 3 09:51:13 2022] POST /identity/v3/services => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:51:15.939424 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182145b-1db4-42b7-b651-4a38dfdf602b None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:15.940319 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182145b-1db4-42b7-b651-4a38dfdf602b None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:15.940319 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182145b-1db4-42b7-b651-4a38dfdf602b None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:15.942489 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 651/1296] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:51:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:51:15.947955 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65376e9a-dc86-442d-a4dc-92c806144c60 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:15.948374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65376e9a-dc86-442d-a4dc-92c806144c60 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:15.948485 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65376e9a-dc86-442d-a4dc-92c806144c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:15.966764 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-65376e9a-dc86-442d-a4dc-92c806144c60 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:51:15.967916 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-65376e9a-dc86-442d-a4dc-92c806144c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:51:16.040070 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 646/1297] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:51:15 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:51:16.063288 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182145b-1db4-42b7-b651-4a38dfdf602b None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:16.174652 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182145b-1db4-42b7-b651-4a38dfdf602b None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:16.207790 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f05344-1499-4238-aed6-bb55eb359c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:16.208534 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f05344-1499-4238-aed6-bb55eb359c1d None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:16.208809 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f05344-1499-4238-aed6-bb55eb359c1d None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:16.209073 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f05344-1499-4238-aed6-bb55eb359c1d None admin] PATH_INFO: `/v3/services/placement` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:16.209725 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f05344-1499-4238-aed6-bb55eb359c1d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:16.211184 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f05344-1499-4238-aed6-bb55eb359c1d None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:16.222835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-e1f05344-1499-4238-aed6-bb55eb359c1d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:51:16.222835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:51:16.222835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:51:16.222835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:51:16.222835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:51:16.222835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:51:16.222835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:51:16.222835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:51:16.222835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:51:16.222835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:51:16.222835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:51:16.222835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:51:16.222835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:51:16.222835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:51:16.222835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:51:16.222835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:51:16.222835 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:51:16.223955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:51:16.223955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:51:16.223955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:51:16.223955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:51:16.223955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:51:16.223955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:51:16.223955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:51:16.223955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:51:16.223955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:51:16.223955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:51:16.223955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:51:16.223955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:51:16.223955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:51:16.223955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:51:16.223955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:51:16.223955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:51:16.224849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:51:16.224849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:51:16.224849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:51:16.224849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:51:16.224849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:51:16.224849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:51:16.224849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:51:16.224849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:51:16.224849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:51:16.224849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:51:16.224849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:51:16.224849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:51:16.224849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:51:16.224849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:51:16.224849 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 652/1298] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 3 09:51:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:51:16.232793 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65376e9a-dc86-442d-a4dc-92c806144c60 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:16.330382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65376e9a-dc86-442d-a4dc-92c806144c60 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:16.363795 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343498c7-82e5-4aad-8266-06572c020c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:16.364441 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343498c7-82e5-4aad-8266-06572c020c61 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:16.364716 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343498c7-82e5-4aad-8266-06572c020c61 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:16.364980 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343498c7-82e5-4aad-8266-06572c020c61 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:16.365684 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343498c7-82e5-4aad-8266-06572c020c61 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:51:16.366009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343498c7-82e5-4aad-8266-06572c020c61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:16.367421 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343498c7-82e5-4aad-8266-06572c020c61 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:16.372739 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 647/1299] 10.222.0.55 () {56 vars in 1116 bytes} [Tue May 3 09:51:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:51:16.379192 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f05344-1499-4238-aed6-bb55eb359c1d None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:16.483351 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f05344-1499-4238-aed6-bb55eb359c1d None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:16.517566 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbe76f-d3f9-4933-9adc-4fe1782ef0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:16.518258 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbe76f-d3f9-4933-9adc-4fe1782ef0c8 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:16.518536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbe76f-d3f9-4933-9adc-4fe1782ef0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:16.518813 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbe76f-d3f9-4933-9adc-4fe1782ef0c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:16.519602 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbe76f-d3f9-4933-9adc-4fe1782ef0c8 None admin] RBAC: Adding query filter params (interface=public, service_id=52929f10147444af9e9708aebdb1e067, region_id=RegionOne) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:51:16.519909 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbe76f-d3f9-4933-9adc-4fe1782ef0c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:16.521275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbe76f-d3f9-4933-9adc-4fe1782ef0c8 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:16.527293 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 653/1300] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 3 09:51:16 2022] GET /identity/v3/endpoints?service_id=52929f10147444af9e9708aebdb1e067&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:51:16.533186 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343498c7-82e5-4aad-8266-06572c020c61 None admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:16.630428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343498c7-82e5-4aad-8266-06572c020c61 None admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:16.665105 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb77c6-3de6-47b4-9e47-52c898e8289a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:16.665740 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb77c6-3de6-47b4-9e47-52c898e8289a None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:16.666052 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb77c6-3de6-47b4-9e47-52c898e8289a None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:16.666322 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb77c6-3de6-47b4-9e47-52c898e8289a None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:16.666995 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb77c6-3de6-47b4-9e47-52c898e8289a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:16.668339 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb77c6-3de6-47b4-9e47-52c898e8289a None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:16.675469 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 648/1301] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 3 09:51:16 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:51:18.890542 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62c20c-589b-430c-872c-5f72aa94b8fa None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:18.891438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62c20c-589b-430c-872c-5f72aa94b8fa None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:18.891438 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62c20c-589b-430c-872c-5f72aa94b8fa None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:18.893603 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 654/1302] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:51:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:51:18.899889 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25443e8-4add-4179-87f9-c2bc55b0e208 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:18.900565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25443e8-4add-4179-87f9-c2bc55b0e208 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:18.900912 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25443e8-4add-4179-87f9-c2bc55b0e208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:18.923271 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-f25443e8-4add-4179-87f9-c2bc55b0e208 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:51:18.924438 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-f25443e8-4add-4179-87f9-c2bc55b0e208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:51:18.992442 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 649/1303] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:51:18 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 09:51:19.028194 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62c20c-589b-430c-872c-5f72aa94b8fa None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:19.133436 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62c20c-589b-430c-872c-5f72aa94b8fa None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:19.167917 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d0345-8ac0-4b47-85bf-2362e9b0b9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:19.168624 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d0345-8ac0-4b47-85bf-2362e9b0b9f3 None admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:19.168898 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d0345-8ac0-4b47-85bf-2362e9b0b9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:19.169164 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d0345-8ac0-4b47-85bf-2362e9b0b9f3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:19.169838 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d0345-8ac0-4b47-85bf-2362e9b0b9f3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:19.171194 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d0345-8ac0-4b47-85bf-2362e9b0b9f3 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:19.183378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application [None req-fd2d0345-8ac0-4b47-85bf-2362e9b0b9f3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:51:19.183378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:51:19.183378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 09:51:19.183378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 09:51:19.183378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 09:51:19.183378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 09:51:19.183378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 09:51:19.183378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:51:19.183378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:51:19.183378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:51:19.183378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 09:51:19.183378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:51:19.183378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 09:51:19.183378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 09:51:19.183378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 09:51:19.183378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 09:51:19.183378 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 09:51:19.184497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 09:51:19.184497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 09:51:19.184497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 09:51:19.184497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 09:51:19.184497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 09:51:19.184497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 09:51:19.184497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 09:51:19.184497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 09:51:19.184497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 09:51:19.184497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 09:51:19.184497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 09:51:19.184497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 09:51:19.184497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 09:51:19.184497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 09:51:19.184497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 09:51:19.184497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.get_or_create( May 03 09:51:19.185688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 09:51:19.185688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application with Lock( May 03 09:51:19.185688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 09:51:19.185688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self._enter() May 03 09:51:19.185688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 09:51:19.185688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 09:51:19.185688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 09:51:19.185688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application return self.creator() May 03 09:51:19.185688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 09:51:19.185688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application created_value = creator( May 03 09:51:19.185688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 09:51:19.185688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 09:51:19.185688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 09:51:19.185688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: ERROR keystone.server.flask.application May 03 09:51:19.185688 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 655/1304] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 3 09:51:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 09:51:19.191192 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25443e8-4add-4179-87f9-c2bc55b0e208 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:19.296411 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25443e8-4add-4179-87f9-c2bc55b0e208 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:19.331401 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fbbbf-3721-42fb-a013-1f646f9f3425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:19.332053 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fbbbf-3721-42fb-a013-1f646f9f3425 None admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:19.332335 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fbbbf-3721-42fb-a013-1f646f9f3425 None admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:19.332604 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fbbbf-3721-42fb-a013-1f646f9f3425 None admin] PATH_INFO: `/v3/services` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:19.333306 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fbbbf-3721-42fb-a013-1f646f9f3425 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:51:19.333611 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fbbbf-3721-42fb-a013-1f646f9f3425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:19.335001 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fbbbf-3721-42fb-a013-1f646f9f3425 None admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:19.340400 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 650/1305] 10.222.0.55 () {56 vars in 1116 bytes} [Tue May 3 09:51:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:51:19.346576 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d0345-8ac0-4b47-85bf-2362e9b0b9f3 None admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:51:19.448763 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d0345-8ac0-4b47-85bf-2362e9b0b9f3 None admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:51:19.481727 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f32ab-85ae-4b34-aeea-ed2e01308aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:51:19.482394 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f32ab-85ae-4b34-aeea-ed2e01308aa5 None admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:51:19.482671 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f32ab-85ae-4b34-aeea-ed2e01308aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:51:19.482941 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f32ab-85ae-4b34-aeea-ed2e01308aa5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:51:19.483673 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f32ab-85ae-4b34-aeea-ed2e01308aa5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:51:19.485037 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f32ab-85ae-4b34-aeea-ed2e01308aa5 None admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:51:19.505888 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 656/1306] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 3 09:51:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:52:22.948608 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d82549-f6af-4c40-a0fd-5a9f990a521a None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:22.951443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d82549-f6af-4c40-a0fd-5a9f990a521a None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:22.952631 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d82549-f6af-4c40-a0fd-5a9f990a521a None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:22.964021 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78b0eb-37a0-4495-b101-55108acf5973 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:22.964966 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78b0eb-37a0-4495-b101-55108acf5973 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:22.965452 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78b0eb-37a0-4495-b101-55108acf5973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:22.968931 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 651/1307] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:52:22 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:52:23.067154 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-cf78b0eb-37a0-4495-b101-55108acf5973 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:52:23.068917 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-cf78b0eb-37a0-4495-b101-55108acf5973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:23.249204 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 657/1308] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:52:23.277717 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3a63f-7ad0-4391-a282-d42b23003828 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:23.278189 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3a63f-7ad0-4391-a282-d42b23003828 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:23.282797 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3a63f-7ad0-4391-a282-d42b23003828 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:23.284332 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 652/1309] 10.222.0.55 () {54 vars in 964 bytes} [Tue May 3 09:52:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:52:23.297756 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15c77-1143-4bb6-9a65-36ca7b820e8b None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:23.298375 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15c77-1143-4bb6-9a65-36ca7b820e8b None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:23.298857 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15c77-1143-4bb6-9a65-36ca7b820e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:23.420985 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-17f15c77-1143-4bb6-9a65-36ca7b820e8b None None] MFA Rules not processed for user `7eb3d5bb36f445cabb62cacf1b34984d`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:52:23.422653 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-17f15c77-1143-4bb6-9a65-36ca7b820e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:23.515383 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3a63f-7ad0-4391-a282-d42b23003828 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:52:23.517506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-c1e3a63f-7ad0-4391-a282-d42b23003828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:23.530154 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 658/1310] 10.222.0.55 () {58 vars in 1061 bytes} [Tue May 3 09:52:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:52:23.634688 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3a63f-7ad0-4391-a282-d42b23003828 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:52:23.711000 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f285c-8547-484d-bbb4-e59b65122001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:52:23.712117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f285c-8547-484d-bbb4-e59b65122001 service neutron] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:23.712607 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f285c-8547-484d-bbb4-e59b65122001 service neutron] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:23.713086 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f285c-8547-484d-bbb4-e59b65122001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:23.714976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-e61f285c-8547-484d-bbb4-e59b65122001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:23.826616 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f285c-8547-484d-bbb4-e59b65122001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:52:23.828441 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f285c-8547-484d-bbb4-e59b65122001 service neutron] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:52:23.870348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 653/1311] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:52:26.435626 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e871b1-4101-412c-8d81-b17734dfb115 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:26.435626 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e871b1-4101-412c-8d81-b17734dfb115 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:26.436095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e871b1-4101-412c-8d81-b17734dfb115 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:26.437061 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 659/1312] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:52:26.442471 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783d0b2-743e-4ba7-9765-5cd5d0ca136b None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:26.442892 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783d0b2-743e-4ba7-9765-5cd5d0ca136b None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:26.443072 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783d0b2-743e-4ba7-9765-5cd5d0ca136b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:26.522813 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-4783d0b2-743e-4ba7-9765-5cd5d0ca136b None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:52:26.523901 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-4783d0b2-743e-4ba7-9765-5cd5d0ca136b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:26.620264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 654/1313] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:52:26.658738 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e871b1-4101-412c-8d81-b17734dfb115 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:52:26.660281 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-48e871b1-4101-412c-8d81-b17734dfb115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:26.762471 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e871b1-4101-412c-8d81-b17734dfb115 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:52:26.836263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038b968-466e-4490-9e97-e50988b1363f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:52:26.836932 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038b968-466e-4490-9e97-e50988b1363f service neutron] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:26.837324 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038b968-466e-4490-9e97-e50988b1363f service neutron] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:26.837637 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038b968-466e-4490-9e97-e50988b1363f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:26.839290 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-7038b968-466e-4490-9e97-e50988b1363f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:26.957556 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038b968-466e-4490-9e97-e50988b1363f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:52:26.959046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038b968-466e-4490-9e97-e50988b1363f service neutron] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:52:26.977636 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 660/1314] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:52:29.489213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03615a0e-4b62-4a5a-9a9f-38c78e78e6c6 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:29.490151 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03615a0e-4b62-4a5a-9a9f-38c78e78e6c6 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:29.490151 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03615a0e-4b62-4a5a-9a9f-38c78e78e6c6 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:29.492264 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 655/1315] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:52:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:52:29.499102 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95900303-e465-4a4d-9c11-04342119fea8 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:29.499541 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95900303-e465-4a4d-9c11-04342119fea8 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:29.499674 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95900303-e465-4a4d-9c11-04342119fea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:29.569003 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-95900303-e465-4a4d-9c11-04342119fea8 None None] MFA Rules not processed for user `73fc2af7c3ea4c41af7c840384744887`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:52:29.570152 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-95900303-e465-4a4d-9c11-04342119fea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:29.677547 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 661/1316] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:52:29.724696 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03615a0e-4b62-4a5a-9a9f-38c78e78e6c6 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:52:29.726322 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-03615a0e-4b62-4a5a-9a9f-38c78e78e6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:29.838399 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03615a0e-4b62-4a5a-9a9f-38c78e78e6c6 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:52:29.918215 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb95b34-9985-41eb-8449-d95d8a61cd83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:52:29.918866 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb95b34-9985-41eb-8449-d95d8a61cd83 service neutron] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:29.919186 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb95b34-9985-41eb-8449-d95d8a61cd83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:29.919450 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb95b34-9985-41eb-8449-d95d8a61cd83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:29.921093 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-6bb95b34-9985-41eb-8449-d95d8a61cd83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:30.037383 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb95b34-9985-41eb-8449-d95d8a61cd83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:52:30.038837 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb95b34-9985-41eb-8449-d95d8a61cd83 service neutron] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:52:30.058074 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 656/1317] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:52:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:52:32.937926 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88462b-7e8d-428c-9806-5256b017b5d6 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:32.938559 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88462b-7e8d-428c-9806-5256b017b5d6 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:32.938559 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88462b-7e8d-428c-9806-5256b017b5d6 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:32.939861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 662/1318] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:52:32.945379 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f61b0-9684-45d3-9586-b7d970581abf None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:32.945855 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f61b0-9684-45d3-9586-b7d970581abf None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:32.945971 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f61b0-9684-45d3-9586-b7d970581abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:33.026408 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-7e2f61b0-9684-45d3-9586-b7d970581abf None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:52:33.027619 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-7e2f61b0-9684-45d3-9586-b7d970581abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:33.145711 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 657/1319] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:52:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:52:33.193189 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88462b-7e8d-428c-9806-5256b017b5d6 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:52:33.195292 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-4b88462b-7e8d-428c-9806-5256b017b5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:33.309967 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88462b-7e8d-428c-9806-5256b017b5d6 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:52:33.402737 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5142da9-8272-47f1-acd5-62d7f95ce1ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:52:33.403294 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5142da9-8272-47f1-acd5-62d7f95ce1ae service neutron] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:33.403564 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5142da9-8272-47f1-acd5-62d7f95ce1ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:33.403829 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5142da9-8272-47f1-acd5-62d7f95ce1ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:33.405466 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-d5142da9-8272-47f1-acd5-62d7f95ce1ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:33.527616 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5142da9-8272-47f1-acd5-62d7f95ce1ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:52:33.529046 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5142da9-8272-47f1-acd5-62d7f95ce1ae service neutron] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:52:33.546550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 663/1320] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:52:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:52:36.438950 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa711f-52bf-42f7-b234-5fa6fecd30fe None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:36.439479 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa711f-52bf-42f7-b234-5fa6fecd30fe None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:36.439479 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa711f-52bf-42f7-b234-5fa6fecd30fe None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:36.440946 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 658/1321] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:52:36.446228 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adfdec-6917-4528-934b-d916cb559ca8 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:36.446710 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adfdec-6917-4528-934b-d916cb559ca8 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:36.446832 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adfdec-6917-4528-934b-d916cb559ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:36.509104 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-e9adfdec-6917-4528-934b-d916cb559ca8 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:52:36.510319 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-e9adfdec-6917-4528-934b-d916cb559ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:36.609943 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 664/1322] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:52:36.659300 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2192ba2-a765-47b0-820c-f453ea84fec9 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:36.659551 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2192ba2-a765-47b0-820c-f453ea84fec9 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:36.659848 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2192ba2-a765-47b0-820c-f453ea84fec9 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:36.661202 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 659/1323] 10.222.0.55 () {54 vars in 964 bytes} [Tue May 3 09:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:52:36.667423 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fb6cd-6b9c-45a0-86e3-f84352ca427a None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:36.667713 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fb6cd-6b9c-45a0-86e3-f84352ca427a None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:36.667986 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fb6cd-6b9c-45a0-86e3-f84352ca427a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:36.745174 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-8a4fb6cd-6b9c-45a0-86e3-f84352ca427a None None] MFA Rules not processed for user `7eb3d5bb36f445cabb62cacf1b34984d`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:52:36.746431 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-8a4fb6cd-6b9c-45a0-86e3-f84352ca427a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:36.823274 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 665/1324] 10.222.0.55 () {58 vars in 1061 bytes} [Tue May 3 09:52:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:52:36.832455 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2192ba2-a765-47b0-820c-f453ea84fec9 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:52:36.834095 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-f2192ba2-a765-47b0-820c-f453ea84fec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:36.941499 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2192ba2-a765-47b0-820c-f453ea84fec9 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:52:37.019343 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929170c-3604-4823-934f-01a20e4792fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:52:37.019991 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929170c-3604-4823-934f-01a20e4792fe service neutron] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:37.020263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929170c-3604-4823-934f-01a20e4792fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:37.020527 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929170c-3604-4823-934f-01a20e4792fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:37.022193 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-a929170c-3604-4823-934f-01a20e4792fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:37.128780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929170c-3604-4823-934f-01a20e4792fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:52:37.130273 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929170c-3604-4823-934f-01a20e4792fe service neutron] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:52:37.149514 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 660/1325] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:52:39.671577 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181846c-e6bc-4ab5-8abe-d3434ca75824 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:39.672132 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181846c-e6bc-4ab5-8abe-d3434ca75824 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:39.672132 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181846c-e6bc-4ab5-8abe-d3434ca75824 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:39.673404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 666/1326] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:52:39.678728 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4aada-1a1a-49d5-b8e3-2370a0283cf6 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:39.679166 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4aada-1a1a-49d5-b8e3-2370a0283cf6 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:39.679257 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4aada-1a1a-49d5-b8e3-2370a0283cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:39.744757 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-8fc4aada-1a1a-49d5-b8e3-2370a0283cf6 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:52:39.745977 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-8fc4aada-1a1a-49d5-b8e3-2370a0283cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:39.844932 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 661/1327] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:52:39.880377 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181846c-e6bc-4ab5-8abe-d3434ca75824 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:52:39.882022 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-0181846c-e6bc-4ab5-8abe-d3434ca75824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:39.992135 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181846c-e6bc-4ab5-8abe-d3434ca75824 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:52:40.070043 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5f769-adb8-423f-9e58-49f4c736f0e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:52:40.070728 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5f769-adb8-423f-9e58-49f4c736f0e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:40.071008 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5f769-adb8-423f-9e58-49f4c736f0e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:40.071279 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5f769-adb8-423f-9e58-49f4c736f0e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:40.073116 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-1cf5f769-adb8-423f-9e58-49f4c736f0e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:40.182448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5f769-adb8-423f-9e58-49f4c736f0e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:52:40.183876 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5f769-adb8-423f-9e58-49f4c736f0e9 service neutron] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:52:40.201514 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 667/1328] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:52:42.493359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15855e1-07c5-4c36-a619-eaa9fb47bdc1 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:42.494190 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15855e1-07c5-4c36-a619-eaa9fb47bdc1 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:42.494190 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15855e1-07c5-4c36-a619-eaa9fb47bdc1 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:42.495300 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 662/1329] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:52:42.500640 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6118db-f31d-4559-ad14-23409273e72d None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:42.501049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6118db-f31d-4559-ad14-23409273e72d None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:42.501221 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6118db-f31d-4559-ad14-23409273e72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:42.566819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-2a6118db-f31d-4559-ad14-23409273e72d None None] MFA Rules not processed for user `73fc2af7c3ea4c41af7c840384744887`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:52:42.567932 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-2a6118db-f31d-4559-ad14-23409273e72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:42.666168 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 668/1330] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:52:42 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:52:42.703996 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15855e1-07c5-4c36-a619-eaa9fb47bdc1 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:52:42.705514 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-d15855e1-07c5-4c36-a619-eaa9fb47bdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:42.815003 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15855e1-07c5-4c36-a619-eaa9fb47bdc1 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:52:42.891735 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d2208-7aa2-4ca1-8450-592c3282711c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:52:42.892300 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d2208-7aa2-4ca1-8450-592c3282711c service neutron] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:42.892573 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d2208-7aa2-4ca1-8450-592c3282711c service neutron] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:42.892843 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d2208-7aa2-4ca1-8450-592c3282711c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:42.894545 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-f98d2208-7aa2-4ca1-8450-592c3282711c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:43.008543 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d2208-7aa2-4ca1-8450-592c3282711c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:52:43.010396 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d2208-7aa2-4ca1-8450-592c3282711c service neutron] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:52:43.029049 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 663/1331] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:52:42 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:52:45.674921 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba85aa0-8749-42c3-a520-d9afa325d3fb None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:45.675529 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba85aa0-8749-42c3-a520-d9afa325d3fb None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:45.675529 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba85aa0-8749-42c3-a520-d9afa325d3fb None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:45.676851 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 669/1332] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:52:45.682616 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df02473-4705-4f3e-95e1-0b79e86119e1 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:45.683067 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df02473-4705-4f3e-95e1-0b79e86119e1 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:45.683169 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df02473-4705-4f3e-95e1-0b79e86119e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:45.751894 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-6df02473-4705-4f3e-95e1-0b79e86119e1 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:52:45.753028 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-6df02473-4705-4f3e-95e1-0b79e86119e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:45.851334 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 664/1333] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:52:45.887874 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba85aa0-8749-42c3-a520-d9afa325d3fb None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:52:45.889419 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-2ba85aa0-8749-42c3-a520-d9afa325d3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:45.995094 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba85aa0-8749-42c3-a520-d9afa325d3fb None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:52:46.067334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9cc88-a8ed-4164-8abd-4bcc3dfdbcb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:52:46.068000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9cc88-a8ed-4164-8abd-4bcc3dfdbcb1 service neutron] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:46.068276 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9cc88-a8ed-4164-8abd-4bcc3dfdbcb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:46.068543 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9cc88-a8ed-4164-8abd-4bcc3dfdbcb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:46.070183 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-f6d9cc88-a8ed-4164-8abd-4bcc3dfdbcb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:46.177486 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9cc88-a8ed-4164-8abd-4bcc3dfdbcb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:52:46.178942 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9cc88-a8ed-4164-8abd-4bcc3dfdbcb1 service neutron] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:52:46.196669 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 670/1334] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:52:48.461629 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd664b-ed48-4396-9714-f7f0c4774588 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:48.462250 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd664b-ed48-4396-9714-f7f0c4774588 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:48.462250 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd664b-ed48-4396-9714-f7f0c4774588 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:48.463673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 665/1335] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:52:48.469858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1271b-7c1f-42cf-997c-bf0d57424393 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:48.470582 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1271b-7c1f-42cf-997c-bf0d57424393 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:48.470766 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1271b-7c1f-42cf-997c-bf0d57424393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:48.538205 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-51c1271b-7c1f-42cf-997c-bf0d57424393 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:52:48.539470 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-51c1271b-7c1f-42cf-997c-bf0d57424393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:48.645144 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 671/1336] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:52:48.693965 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd664b-ed48-4396-9714-f7f0c4774588 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:52:48.696268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-87fd664b-ed48-4396-9714-f7f0c4774588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:48.810195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd664b-ed48-4396-9714-f7f0c4774588 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:52:48.892173 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac8749-d515-4403-ad57-718d8b7311a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:52:48.892820 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac8749-d515-4403-ad57-718d8b7311a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:48.893096 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac8749-d515-4403-ad57-718d8b7311a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:48.893363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac8749-d515-4403-ad57-718d8b7311a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:48.895017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-26ac8749-d515-4403-ad57-718d8b7311a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:49.011116 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac8749-d515-4403-ad57-718d8b7311a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:52:49.012530 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac8749-d515-4403-ad57-718d8b7311a7 service neutron] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:52:49.032012 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 666/1337] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:52:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:52:51.563052 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd879d7-3938-40e4-8bd8-0d46c8142497 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:51.563581 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd879d7-3938-40e4-8bd8-0d46c8142497 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:51.563581 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd879d7-3938-40e4-8bd8-0d46c8142497 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:51.564903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 672/1338] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:52:51.571317 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f04ef-4554-4c39-a6c7-66ba6dc7961d None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:51.572076 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f04ef-4554-4c39-a6c7-66ba6dc7961d None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:51.572168 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f04ef-4554-4c39-a6c7-66ba6dc7961d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:51.642233 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-a90f04ef-4554-4c39-a6c7-66ba6dc7961d None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:52:51.643469 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-a90f04ef-4554-4c39-a6c7-66ba6dc7961d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:51.738242 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 667/1339] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:52:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:52:51.777549 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd879d7-3938-40e4-8bd8-0d46c8142497 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:52:51.779130 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-bcd879d7-3938-40e4-8bd8-0d46c8142497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:51.880641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd879d7-3938-40e4-8bd8-0d46c8142497 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:52:51.963569 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b336f70-3e91-4903-a121-c8ebcc3593a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:52:51.964226 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b336f70-3e91-4903-a121-c8ebcc3593a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:51.964522 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b336f70-3e91-4903-a121-c8ebcc3593a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:51.964775 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b336f70-3e91-4903-a121-c8ebcc3593a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:51.966451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-0b336f70-3e91-4903-a121-c8ebcc3593a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:52.084455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b336f70-3e91-4903-a121-c8ebcc3593a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:52:52.085916 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b336f70-3e91-4903-a121-c8ebcc3593a2 service neutron] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:52:52.105071 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 673/1340] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:52:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:52:56.330290 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d166ef-fda7-48b4-8361-5ba9b3a59bd3 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:56.330868 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d166ef-fda7-48b4-8361-5ba9b3a59bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:56.330868 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d166ef-fda7-48b4-8361-5ba9b3a59bd3 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:56.332201 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 668/1341] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:52:56.338149 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9770b-d49f-448e-9e04-1fe32d0e541a None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:56.338634 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9770b-d49f-448e-9e04-1fe32d0e541a None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:56.338959 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9770b-d49f-448e-9e04-1fe32d0e541a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:56.408585 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-55a9770b-d49f-448e-9e04-1fe32d0e541a None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:52:56.409941 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-55a9770b-d49f-448e-9e04-1fe32d0e541a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:56.511975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 674/1342] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:52:56.550934 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d166ef-fda7-48b4-8361-5ba9b3a59bd3 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:52:56.553475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-e1d166ef-fda7-48b4-8361-5ba9b3a59bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:56.651927 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d166ef-fda7-48b4-8361-5ba9b3a59bd3 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:52:56.655646 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec57a1-1caa-408b-84fc-8fdf0f92494a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:52:56.656318 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec57a1-1caa-408b-84fc-8fdf0f92494a service neutron] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:56.656603 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec57a1-1caa-408b-84fc-8fdf0f92494a service neutron] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:56.656875 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec57a1-1caa-408b-84fc-8fdf0f92494a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:56.665930 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec57a1-1caa-408b-84fc-8fdf0f92494a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:52:56.667532 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec57a1-1caa-408b-84fc-8fdf0f92494a service neutron] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:52:56.677254 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 669/1343] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:52:59.651339 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d997bfd-5bb4-4776-bc01-e8480fa62be9 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:59.651979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d997bfd-5bb4-4776-bc01-e8480fa62be9 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:59.651979 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d997bfd-5bb4-4776-bc01-e8480fa62be9 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:59.653267 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 675/1344] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:52:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:52:59.659033 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc076b-23b4-49b1-b7bc-912d7d07fe4b None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:59.659490 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc076b-23b4-49b1-b7bc-912d7d07fe4b None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:59.659593 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc076b-23b4-49b1-b7bc-912d7d07fe4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:59.688484 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-c6dc076b-23b4-49b1-b7bc-912d7d07fe4b None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:52:59.689678 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-c6dc076b-23b4-49b1-b7bc-912d7d07fe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:52:59.768112 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 670/1345] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:52:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:52:59.807471 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d997bfd-5bb4-4776-bc01-e8480fa62be9 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:52:59.818369 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d997bfd-5bb4-4776-bc01-e8480fa62be9 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:52:59.821951 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578eab0-d3b7-45ca-9c01-40be9179faaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:52:59.822581 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578eab0-d3b7-45ca-9c01-40be9179faaa service neutron] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:52:59.822861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578eab0-d3b7-45ca-9c01-40be9179faaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:52:59.823132 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578eab0-d3b7-45ca-9c01-40be9179faaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:52:59.842169 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578eab0-d3b7-45ca-9c01-40be9179faaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:52:59.843624 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578eab0-d3b7-45ca-9c01-40be9179faaa service neutron] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:52:59.854650 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 676/1346] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:52:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:53:04.272888 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f7f0b-bea7-430f-afe3-dd0ac39ec916 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:04.273486 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f7f0b-bea7-430f-afe3-dd0ac39ec916 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:04.273486 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f7f0b-bea7-430f-afe3-dd0ac39ec916 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:04.274822 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 671/1347] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:04.280518 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9bab2-683f-4fc8-a965-dc2a726d47e2 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:04.280950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9bab2-683f-4fc8-a965-dc2a726d47e2 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:04.281141 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9bab2-683f-4fc8-a965-dc2a726d47e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:04.299351 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-add9bab2-683f-4fc8-a965-dc2a726d47e2 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:04.300536 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-add9bab2-683f-4fc8-a965-dc2a726d47e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:04.309247 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 677/1348] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:04.347017 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f7f0b-bea7-430f-afe3-dd0ac39ec916 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:53:04.348920 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-f55f7f0b-bea7-430f-afe3-dd0ac39ec916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:04.362352 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f7f0b-bea7-430f-afe3-dd0ac39ec916 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:53:04.365904 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3237a2-c0dc-4811-9297-56cee97d3b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:53:04.366548 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3237a2-c0dc-4811-9297-56cee97d3b61 service neutron] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:04.366829 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3237a2-c0dc-4811-9297-56cee97d3b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:04.367101 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3237a2-c0dc-4811-9297-56cee97d3b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:04.376962 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3237a2-c0dc-4811-9297-56cee97d3b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:53:04.378415 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3237a2-c0dc-4811-9297-56cee97d3b61 service neutron] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:53:04.387660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 672/1349] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:53:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:53:09.735186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d21d4-8cf1-41dc-a529-c1e1cb393887 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:09.735673 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d21d4-8cf1-41dc-a529-c1e1cb393887 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:09.735673 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d21d4-8cf1-41dc-a529-c1e1cb393887 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:09.737728 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 678/1350] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 3 09:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:09.743965 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b450d-ff66-42d6-ad45-d61951948fd1 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:09.744750 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b450d-ff66-42d6-ad45-d61951948fd1 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:09.745197 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b450d-ff66-42d6-ad45-d61951948fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:09.816848 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-a23b450d-ff66-42d6-ad45-d61951948fd1 None None] MFA Rules not processed for user `26bee0f9d8c341fca8290b2fbc95e1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:09.818439 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-a23b450d-ff66-42d6-ad45-d61951948fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:09.896032 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 673/1351] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 3 09:53:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:14.192908 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f995b6-6d15-4db1-9dd0-35ce1a8ba0c8 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:14.193455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f995b6-6d15-4db1-9dd0-35ce1a8ba0c8 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:14.193455 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f995b6-6d15-4db1-9dd0-35ce1a8ba0c8 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:14.195049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 679/1352] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 3 09:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:14.200239 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3596c41-0727-478b-a2fc-559c9d217992 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:14.200708 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3596c41-0727-478b-a2fc-559c9d217992 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:14.200998 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3596c41-0727-478b-a2fc-559c9d217992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:14.221136 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-d3596c41-0727-478b-a2fc-559c9d217992 None None] MFA Rules not processed for user `26bee0f9d8c341fca8290b2fbc95e1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:14.222639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-d3596c41-0727-478b-a2fc-559c9d217992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:14.231865 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 674/1353] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 3 09:53:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:15.695685 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb155eb-273c-4550-bd63-9d30f5a11f5f None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:15.696483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb155eb-273c-4550-bd63-9d30f5a11f5f None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:15.696483 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb155eb-273c-4550-bd63-9d30f5a11f5f None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:15.697753 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 680/1354] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 3 09:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:15.702768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9248-602a-4a51-9f0b-b7b6fc7d3bf4 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:15.703183 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9248-602a-4a51-9f0b-b7b6fc7d3bf4 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:15.703428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9248-602a-4a51-9f0b-b7b6fc7d3bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:15.722044 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-ed1c9248-602a-4a51-9f0b-b7b6fc7d3bf4 None None] MFA Rules not processed for user `26bee0f9d8c341fca8290b2fbc95e1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:15.723210 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-ed1c9248-602a-4a51-9f0b-b7b6fc7d3bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:15.732139 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 675/1355] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 3 09:53:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:19.510036 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658095df-fcbc-4c06-8dd0-d80855e069fa None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:19.510549 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658095df-fcbc-4c06-8dd0-d80855e069fa None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:19.510549 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658095df-fcbc-4c06-8dd0-d80855e069fa None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:19.512112 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 681/1356] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:19.517752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcba8e0-9c2f-46b6-b0ad-0862cad31004 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:19.518226 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcba8e0-9c2f-46b6-b0ad-0862cad31004 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:19.518320 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcba8e0-9c2f-46b6-b0ad-0862cad31004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:19.536348 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-1fcba8e0-9c2f-46b6-b0ad-0862cad31004 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:19.537489 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-1fcba8e0-9c2f-46b6-b0ad-0862cad31004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:19.546405 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 676/1357] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:19.595691 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c61eb-3683-43c5-b10d-5065ed2bf105 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:19.595970 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c61eb-3683-43c5-b10d-5065ed2bf105 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:19.596245 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c61eb-3683-43c5-b10d-5065ed2bf105 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:19.597609 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 682/1358] 10.222.0.55 () {54 vars in 960 bytes} [Tue May 3 09:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:19.603540 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5651d-1d6f-4cd3-a65f-6efa5e5aa682 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:19.603900 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5651d-1d6f-4cd3-a65f-6efa5e5aa682 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:19.604244 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5651d-1d6f-4cd3-a65f-6efa5e5aa682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:19.652397 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-3ff5651d-1d6f-4cd3-a65f-6efa5e5aa682 None None] MFA Rules not processed for user `efb008cfc6424998917da60d72689f55`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:19.653593 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-3ff5651d-1d6f-4cd3-a65f-6efa5e5aa682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:19.732393 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 677/1359] 10.222.0.55 () {58 vars in 1057 bytes} [Tue May 3 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:19.740421 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c61eb-3683-43c5-b10d-5065ed2bf105 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:53:19.755680 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c61eb-3683-43c5-b10d-5065ed2bf105 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:53:19.761504 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbfee3-2f1a-4680-990b-eb2983f3631c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:53:19.762246 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbfee3-2f1a-4680-990b-eb2983f3631c service nova] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:19.762626 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbfee3-2f1a-4680-990b-eb2983f3631c service nova] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:19.762994 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbfee3-2f1a-4680-990b-eb2983f3631c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:19.772571 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbfee3-2f1a-4680-990b-eb2983f3631c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:53:19.774651 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbfee3-2f1a-4680-990b-eb2983f3631c service nova] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:53:19.786886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 683/1360] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:53:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:53:22.256539 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420b31f-031d-4306-9640-8d56210efbfa None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:22.257178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420b31f-031d-4306-9640-8d56210efbfa None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:22.257178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420b31f-031d-4306-9640-8d56210efbfa None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:22.258439 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 678/1361] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:22.263975 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffaa4d-f7f9-4710-9498-cfcc79dfa656 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:22.264476 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffaa4d-f7f9-4710-9498-cfcc79dfa656 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:22.264752 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffaa4d-f7f9-4710-9498-cfcc79dfa656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:22.284289 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-8cffaa4d-f7f9-4710-9498-cfcc79dfa656 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:22.285716 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-8cffaa4d-f7f9-4710-9498-cfcc79dfa656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:22.294349 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 684/1362] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:22.337864 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420b31f-031d-4306-9640-8d56210efbfa None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:53:22.352935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420b31f-031d-4306-9640-8d56210efbfa None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:53:22.358670 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df7fd0-8999-43aa-a79c-07e7b79be11c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:53:22.359485 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df7fd0-8999-43aa-a79c-07e7b79be11c service nova] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:22.359928 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df7fd0-8999-43aa-a79c-07e7b79be11c service nova] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:22.360350 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df7fd0-8999-43aa-a79c-07e7b79be11c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:22.370089 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df7fd0-8999-43aa-a79c-07e7b79be11c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:53:22.372004 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df7fd0-8999-43aa-a79c-07e7b79be11c service nova] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:53:22.381672 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 679/1363] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:53:24.930488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09553345-bb5a-45dc-a2c5-fc3c5ff53b7f None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:24.931059 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09553345-bb5a-45dc-a2c5-fc3c5ff53b7f None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:24.931059 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09553345-bb5a-45dc-a2c5-fc3c5ff53b7f None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:24.932614 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 685/1364] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:24.938191 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c35d3-e3f5-4b7d-9cba-74a9fdf785b6 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:24.938679 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c35d3-e3f5-4b7d-9cba-74a9fdf785b6 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:24.938783 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c35d3-e3f5-4b7d-9cba-74a9fdf785b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:24.956595 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-c51c35d3-e3f5-4b7d-9cba-74a9fdf785b6 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:24.957771 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-c51c35d3-e3f5-4b7d-9cba-74a9fdf785b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:24.966406 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 680/1365] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:25.010869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4e8da-2051-4fd8-8fdd-22f1f5990374 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:25.011255 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4e8da-2051-4fd8-8fdd-22f1f5990374 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:25.011417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4e8da-2051-4fd8-8fdd-22f1f5990374 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:25.012850 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 686/1366] 10.222.0.55 () {54 vars in 960 bytes} [Tue May 3 09:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:25.018535 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ede9f1-0797-45ec-ae5e-d3d163d22252 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:25.018947 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ede9f1-0797-45ec-ae5e-d3d163d22252 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:25.019281 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ede9f1-0797-45ec-ae5e-d3d163d22252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:25.038435 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-f0ede9f1-0797-45ec-ae5e-d3d163d22252 None None] MFA Rules not processed for user `efb008cfc6424998917da60d72689f55`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:25.040196 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-f0ede9f1-0797-45ec-ae5e-d3d163d22252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:25.049639 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 681/1367] 10.222.0.55 () {58 vars in 1057 bytes} [Tue May 3 09:53:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:25.058001 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4e8da-2051-4fd8-8fdd-22f1f5990374 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:53:25.073869 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4e8da-2051-4fd8-8fdd-22f1f5990374 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:53:25.079765 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccac92-aaf1-40ec-9d9b-ffed0425d51f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:53:25.080398 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccac92-aaf1-40ec-9d9b-ffed0425d51f service nova] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:25.080679 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccac92-aaf1-40ec-9d9b-ffed0425d51f service nova] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:25.080935 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccac92-aaf1-40ec-9d9b-ffed0425d51f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:25.089306 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ccac92-aaf1-40ec-9d9b-ffed0425d51f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:53:25.090944 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ccac92-aaf1-40ec-9d9b-ffed0425d51f service nova] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:53:25.100451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 687/1368] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:53:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:53:27.405071 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac794f-47af-402b-9dc7-a76bc6e19fc3 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:27.405676 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac794f-47af-402b-9dc7-a76bc6e19fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:27.405676 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac794f-47af-402b-9dc7-a76bc6e19fc3 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:27.407011 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 682/1369] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:27.413359 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ce3f7-ba6b-4802-8a7c-093605a103b4 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:27.413941 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ce3f7-ba6b-4802-8a7c-093605a103b4 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:27.414353 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ce3f7-ba6b-4802-8a7c-093605a103b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:27.436138 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-e01ce3f7-ba6b-4802-8a7c-093605a103b4 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:27.437370 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-e01ce3f7-ba6b-4802-8a7c-093605a103b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:27.445824 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 688/1370] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:27.490278 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac794f-47af-402b-9dc7-a76bc6e19fc3 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:53:27.505638 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac794f-47af-402b-9dc7-a76bc6e19fc3 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:53:27.512040 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7eca6-8e56-4d92-ab76-97907fe5f7bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:53:27.513066 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7eca6-8e56-4d92-ab76-97907fe5f7bd service nova] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:27.513544 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7eca6-8e56-4d92-ab76-97907fe5f7bd service nova] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:27.514087 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7eca6-8e56-4d92-ab76-97907fe5f7bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:27.523294 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7eca6-8e56-4d92-ab76-97907fe5f7bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:53:27.525137 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7eca6-8e56-4d92-ab76-97907fe5f7bd service nova] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:53:27.545785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 683/1371] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:53:27.583161 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0d73e-0bb8-449c-beed-1da1dc991889 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:27.583451 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0d73e-0bb8-449c-beed-1da1dc991889 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:27.583732 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0d73e-0bb8-449c-beed-1da1dc991889 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:27.585145 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 689/1372] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:27.591359 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd2a03-b02a-4412-81ce-7082a6eda200 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:27.591996 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd2a03-b02a-4412-81ce-7082a6eda200 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:27.592959 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd2a03-b02a-4412-81ce-7082a6eda200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:27.611624 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-ebbd2a03-b02a-4412-81ce-7082a6eda200 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:27.612931 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-ebbd2a03-b02a-4412-81ce-7082a6eda200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:27.626100 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 684/1373] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:27.902855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07517a-7e20-4956-a72f-287ef2e19d69 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:27.903143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07517a-7e20-4956-a72f-287ef2e19d69 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:27.903410 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07517a-7e20-4956-a72f-287ef2e19d69 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:27.904962 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 690/1374] 10.222.0.55 () {54 vars in 963 bytes} [Tue May 3 09:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:27.910427 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e29ab-138d-4cd6-83e0-8fe59d6b3cab None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:27.910713 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e29ab-138d-4cd6-83e0-8fe59d6b3cab None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:27.910985 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e29ab-138d-4cd6-83e0-8fe59d6b3cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:27.960660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-bb7e29ab-138d-4cd6-83e0-8fe59d6b3cab None None] MFA Rules not processed for user `f361b5ebd2b246c4bed5be82a70f63e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:27.962080 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-bb7e29ab-138d-4cd6-83e0-8fe59d6b3cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:28.021943 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 685/1375] 10.222.0.55 () {58 vars in 1060 bytes} [Tue May 3 09:53:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:28.029450 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07517a-7e20-4956-a72f-287ef2e19d69 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:53:28.040075 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07517a-7e20-4956-a72f-287ef2e19d69 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:53:28.043559 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad7849-0ffa-4e37-823d-fc706d4cbfe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f361b5ebd2b246c4bed5be82a70f63e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:53:28.044212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad7849-0ffa-4e37-823d-fc706d4cbfe9 service cinder] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:28.044487 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad7849-0ffa-4e37-823d-fc706d4cbfe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:28.044743 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad7849-0ffa-4e37-823d-fc706d4cbfe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:28.053594 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad7849-0ffa-4e37-823d-fc706d4cbfe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:53:28.055096 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad7849-0ffa-4e37-823d-fc706d4cbfe9 service cinder] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:53:28.064852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 691/1376] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:53:29.838909 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ea668-02fd-4a13-9713-0fdd92ffd3ee None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:29.839494 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ea668-02fd-4a13-9713-0fdd92ffd3ee None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:29.839494 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ea668-02fd-4a13-9713-0fdd92ffd3ee None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:29.840819 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 686/1377] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:29.846347 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebeb54-4390-4406-a3a6-4fc64c11d92e None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:29.846820 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebeb54-4390-4406-a3a6-4fc64c11d92e None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:29.846935 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebeb54-4390-4406-a3a6-4fc64c11d92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:29.864903 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-73ebeb54-4390-4406-a3a6-4fc64c11d92e None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:29.866119 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-73ebeb54-4390-4406-a3a6-4fc64c11d92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:29.874332 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 692/1378] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:29.920139 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ea668-02fd-4a13-9713-0fdd92ffd3ee None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:53:29.936335 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ea668-02fd-4a13-9713-0fdd92ffd3ee None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:53:29.942592 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b31a06-edf9-4006-941c-e9b98b3de857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:53:29.943237 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b31a06-edf9-4006-941c-e9b98b3de857 service nova] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:29.943517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b31a06-edf9-4006-941c-e9b98b3de857 service nova] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:29.943774 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b31a06-edf9-4006-941c-e9b98b3de857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:29.952178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b31a06-edf9-4006-941c-e9b98b3de857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:53:29.953752 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b31a06-edf9-4006-941c-e9b98b3de857 service nova] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:53:29.963475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 687/1379] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:53:32.249886 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0cfa4-4c7d-472d-b05d-03d1396f70cb None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:32.250992 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0cfa4-4c7d-472d-b05d-03d1396f70cb None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:32.251501 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0cfa4-4c7d-472d-b05d-03d1396f70cb None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:32.257166 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 693/1380] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:53:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:32.259408 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea662dda-4fb8-4c0a-8606-e60ea6cb4e1f None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:32.259868 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea662dda-4fb8-4c0a-8606-e60ea6cb4e1f None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:32.260135 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea662dda-4fb8-4c0a-8606-e60ea6cb4e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:32.280806 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-ea662dda-4fb8-4c0a-8606-e60ea6cb4e1f None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:32.282365 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-ea662dda-4fb8-4c0a-8606-e60ea6cb4e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:32.294884 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 688/1381] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:53:32.338071 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0cfa4-4c7d-472d-b05d-03d1396f70cb None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:53:32.352682 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0cfa4-4c7d-472d-b05d-03d1396f70cb None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:53:32.358430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56a567-fa06-4f9f-9833-e9bace28b37c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:53:32.359057 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56a567-fa06-4f9f-9833-e9bace28b37c service nova] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:32.359494 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56a567-fa06-4f9f-9833-e9bace28b37c service nova] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:32.359953 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56a567-fa06-4f9f-9833-e9bace28b37c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:32.368501 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56a567-fa06-4f9f-9833-e9bace28b37c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:53:32.370440 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56a567-fa06-4f9f-9833-e9bace28b37c service nova] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:53:32.380354 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 694/1382] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:53:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:53:34.803230 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9fe89-222c-4472-9456-345157fc78b4 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:34.803886 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9fe89-222c-4472-9456-345157fc78b4 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:34.804019 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9fe89-222c-4472-9456-345157fc78b4 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:34.805885 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 689/1383] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:53:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:34.812545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd1ec7-32aa-49bf-ba23-97f3f2e413e7 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:34.813138 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd1ec7-32aa-49bf-ba23-97f3f2e413e7 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:34.813239 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd1ec7-32aa-49bf-ba23-97f3f2e413e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:34.833964 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-3dcd1ec7-32aa-49bf-ba23-97f3f2e413e7 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:34.835245 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-3dcd1ec7-32aa-49bf-ba23-97f3f2e413e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:34.844727 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 695/1384] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:34.888800 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9fe89-222c-4472-9456-345157fc78b4 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:53:34.905158 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9fe89-222c-4472-9456-345157fc78b4 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:53:34.911281 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed1b17-2545-49fe-a463-38b2d57d7266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:53:34.912134 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed1b17-2545-49fe-a463-38b2d57d7266 service nova] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:34.912572 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed1b17-2545-49fe-a463-38b2d57d7266 service nova] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:34.912844 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed1b17-2545-49fe-a463-38b2d57d7266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:34.922767 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed1b17-2545-49fe-a463-38b2d57d7266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:53:34.924368 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed1b17-2545-49fe-a463-38b2d57d7266 service nova] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:53:34.934707 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 690/1385] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:53:37.182477 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f5138-535d-4688-a9bb-706a6748a04b None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:37.183042 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f5138-535d-4688-a9bb-706a6748a04b None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:37.183042 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f5138-535d-4688-a9bb-706a6748a04b None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:37.184410 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 696/1386] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:37.190945 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ada58-6fbe-41e2-8f9a-5412b30e80e5 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:37.191378 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ada58-6fbe-41e2-8f9a-5412b30e80e5 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:37.191590 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ada58-6fbe-41e2-8f9a-5412b30e80e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:37.213403 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-e83ada58-6fbe-41e2-8f9a-5412b30e80e5 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:37.214554 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-e83ada58-6fbe-41e2-8f9a-5412b30e80e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:37.223448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 691/1387] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:37.268668 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f5138-535d-4688-a9bb-706a6748a04b None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:53:37.284183 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f5138-535d-4688-a9bb-706a6748a04b None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:53:37.291327 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7c48d-b85f-4533-af8f-cddaef11d12f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:53:37.292155 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7c48d-b85f-4533-af8f-cddaef11d12f service nova] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:37.292427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7c48d-b85f-4533-af8f-cddaef11d12f service nova] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:37.292763 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7c48d-b85f-4533-af8f-cddaef11d12f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:37.302334 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7c48d-b85f-4533-af8f-cddaef11d12f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:53:37.303945 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7c48d-b85f-4533-af8f-cddaef11d12f service nova] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:53:37.314187 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 697/1388] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:53:39.660732 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf085a1-f0ee-4a34-9ead-0b514fe3ffc6 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:39.661275 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf085a1-f0ee-4a34-9ead-0b514fe3ffc6 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:39.661275 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf085a1-f0ee-4a34-9ead-0b514fe3ffc6 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:39.662617 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 692/1389] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:39.668568 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0bb97-414c-4607-9f0b-e1819755be1a None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:39.669674 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0bb97-414c-4607-9f0b-e1819755be1a None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:39.669674 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0bb97-414c-4607-9f0b-e1819755be1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:39.689899 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-81b0bb97-414c-4607-9f0b-e1819755be1a None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:39.691099 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-81b0bb97-414c-4607-9f0b-e1819755be1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:39.699287 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 698/1390] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:39.745715 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf085a1-f0ee-4a34-9ead-0b514fe3ffc6 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:53:39.765906 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf085a1-f0ee-4a34-9ead-0b514fe3ffc6 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:53:39.774529 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe4323-214e-4b67-83fa-fd3dac12ea94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:53:39.775172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe4323-214e-4b67-83fa-fd3dac12ea94 service nova] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:39.775448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe4323-214e-4b67-83fa-fd3dac12ea94 service nova] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:39.775737 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe4323-214e-4b67-83fa-fd3dac12ea94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:39.785260 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe4323-214e-4b67-83fa-fd3dac12ea94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:53:39.786887 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe4323-214e-4b67-83fa-fd3dac12ea94 service nova] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:53:39.797083 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 693/1391] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:53:42.254607 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346829b-32d8-493c-9885-dae915b12ac3 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:42.255161 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346829b-32d8-493c-9885-dae915b12ac3 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:42.255161 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346829b-32d8-493c-9885-dae915b12ac3 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:42.256554 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 699/1392] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:42.262751 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b36ad-0628-4730-9477-d5e1d7e92813 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:42.263232 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b36ad-0628-4730-9477-d5e1d7e92813 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:42.263475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b36ad-0628-4730-9477-d5e1d7e92813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:42.286351 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-391b36ad-0628-4730-9477-d5e1d7e92813 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:42.287506 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-391b36ad-0628-4730-9477-d5e1d7e92813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:42.297006 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 694/1393] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:42.343465 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346829b-32d8-493c-9885-dae915b12ac3 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:53:42.358858 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346829b-32d8-493c-9885-dae915b12ac3 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:53:42.365225 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d51ab-90fa-4073-8a5a-eac892681359 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:53:42.365913 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d51ab-90fa-4073-8a5a-eac892681359 service nova] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:42.366247 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d51ab-90fa-4073-8a5a-eac892681359 service nova] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:42.366501 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d51ab-90fa-4073-8a5a-eac892681359 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:42.375463 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d51ab-90fa-4073-8a5a-eac892681359 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:53:42.377114 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d51ab-90fa-4073-8a5a-eac892681359 service nova] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:53:42.386882 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 700/1394] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:53:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:53:44.658755 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbe2dc-19f6-45d2-ab0b-1f5bb3463392 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:44.659485 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbe2dc-19f6-45d2-ab0b-1f5bb3463392 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:44.659485 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbe2dc-19f6-45d2-ab0b-1f5bb3463392 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:44.660690 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 695/1395] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:44.667076 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64c005-f516-4163-9d4f-c31436e3e3c7 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:44.667545 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64c005-f516-4163-9d4f-c31436e3e3c7 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:44.667771 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64c005-f516-4163-9d4f-c31436e3e3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:44.687939 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-7c64c005-f516-4163-9d4f-c31436e3e3c7 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:44.689105 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-7c64c005-f516-4163-9d4f-c31436e3e3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:44.697344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 701/1396] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:53:44.743566 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbe2dc-19f6-45d2-ab0b-1f5bb3463392 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:53:44.760963 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbe2dc-19f6-45d2-ab0b-1f5bb3463392 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:53:44.766751 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9206395-e83b-42d9-92f4-f9ab25b66f4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:53:44.767391 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9206395-e83b-42d9-92f4-f9ab25b66f4b service nova] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:44.767662 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9206395-e83b-42d9-92f4-f9ab25b66f4b service nova] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:44.767935 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9206395-e83b-42d9-92f4-f9ab25b66f4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:44.776774 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9206395-e83b-42d9-92f4-f9ab25b66f4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:53:44.778416 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9206395-e83b-42d9-92f4-f9ab25b66f4b service nova] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:53:44.787824 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 696/1397] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:53:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:53:47.059807 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c9b62-8dd9-46c9-922c-be96418e8a82 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:47.060413 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c9b62-8dd9-46c9-922c-be96418e8a82 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:47.060413 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c9b62-8dd9-46c9-922c-be96418e8a82 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:47.061715 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 702/1398] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:47.067293 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdea556-d37d-4009-8afc-d735dbf03ca7 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:47.068227 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdea556-d37d-4009-8afc-d735dbf03ca7 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:47.068565 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdea556-d37d-4009-8afc-d735dbf03ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:47.086448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-fbdea556-d37d-4009-8afc-d735dbf03ca7 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:47.088006 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-fbdea556-d37d-4009-8afc-d735dbf03ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:47.096908 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 697/1399] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:47.141723 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c9b62-8dd9-46c9-922c-be96418e8a82 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:53:47.156355 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c9b62-8dd9-46c9-922c-be96418e8a82 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:53:47.162251 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4ab7b-be7b-49aa-9a3f-a3cd0c53b8d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:53:47.163198 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4ab7b-be7b-49aa-9a3f-a3cd0c53b8d0 service nova] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:47.163484 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4ab7b-be7b-49aa-9a3f-a3cd0c53b8d0 service nova] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:47.163757 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4ab7b-be7b-49aa-9a3f-a3cd0c53b8d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:47.172201 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4ab7b-be7b-49aa-9a3f-a3cd0c53b8d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:53:47.173704 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4ab7b-be7b-49aa-9a3f-a3cd0c53b8d0 service nova] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:53:47.183115 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 703/1400] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:53:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:53:47.830597 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b57cd9-5e00-48dd-b550-2612e853efe7 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:47.830869 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b57cd9-5e00-48dd-b550-2612e853efe7 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:47.831131 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b57cd9-5e00-48dd-b550-2612e853efe7 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:47.832569 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 698/1401] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:47.838063 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a858ae-912d-498f-adc5-8deb424909c4 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:47.838349 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a858ae-912d-498f-adc5-8deb424909c4 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:47.838620 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a858ae-912d-498f-adc5-8deb424909c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:47.859498 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-27a858ae-912d-498f-adc5-8deb424909c4 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:47.860670 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-27a858ae-912d-498f-adc5-8deb424909c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:47.872201 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 704/1402] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:47.928304 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3485ab7-66ca-4144-abb2-6c1a6a0b0253 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:47.928695 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3485ab7-66ca-4144-abb2-6c1a6a0b0253 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:47.928999 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3485ab7-66ca-4144-abb2-6c1a6a0b0253 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:47.930443 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 699/1403] 10.222.0.55 () {54 vars in 962 bytes} [Tue May 3 09:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:47.935595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62cd19-e533-411a-bd17-548c2ac752d9 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:47.935911 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62cd19-e533-411a-bd17-548c2ac752d9 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:47.936188 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62cd19-e533-411a-bd17-548c2ac752d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:47.988128 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-2a62cd19-e533-411a-bd17-548c2ac752d9 None None] MFA Rules not processed for user `d5b508ac957b4224912fbc2c2f1ea324`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:47.989307 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-2a62cd19-e533-411a-bd17-548c2ac752d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:48.054653 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 705/1404] 10.222.0.55 () {58 vars in 1059 bytes} [Tue May 3 09:53:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:48.062623 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3485ab7-66ca-4144-abb2-6c1a6a0b0253 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:53:48.075568 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3485ab7-66ca-4144-abb2-6c1a6a0b0253 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:53:48.079747 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03388de9-1abd-402a-baee-de78215e880f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b508ac957b4224912fbc2c2f1ea324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:53:48.080861 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03388de9-1abd-402a-baee-de78215e880f service glance] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:48.081206 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03388de9-1abd-402a-baee-de78215e880f service glance] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:48.081633 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03388de9-1abd-402a-baee-de78215e880f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:48.093188 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03388de9-1abd-402a-baee-de78215e880f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:53:48.094657 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03388de9-1abd-402a-baee-de78215e880f service glance] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:53:48.105751 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 700/1405] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:53:48.557712 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9309b11-1081-41af-9074-ef59ca02038e None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:48.558233 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9309b11-1081-41af-9074-ef59ca02038e None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:48.558344 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9309b11-1081-41af-9074-ef59ca02038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:48.605819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-d9309b11-1081-41af-9074-ef59ca02038e None None] MFA Rules not processed for user `62b336ab0cfd4bfd9ec498dcd940332f`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:48.607014 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-d9309b11-1081-41af-9074-ef59ca02038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:48.674313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 706/1406] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 3 09:53:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:48.718772 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268c430-401d-4241-8a5a-d349a1744653 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:48.719144 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268c430-401d-4241-8a5a-d349a1744653 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:48.719448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268c430-401d-4241-8a5a-d349a1744653 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:48.720824 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 701/1407] 10.222.0.55 () {54 vars in 942 bytes} [Tue May 3 09:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:53:48.727202 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164fd04-7a0a-41f4-beed-2617f8719de6 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:48.727496 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164fd04-7a0a-41f4-beed-2617f8719de6 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:48.727802 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164fd04-7a0a-41f4-beed-2617f8719de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:48.787232 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-3164fd04-7a0a-41f4-beed-2617f8719de6 None None] MFA Rules not processed for user `73dfc1b485d647f1ae59a405c978599f`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:53:48.788518 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-3164fd04-7a0a-41f4-beed-2617f8719de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:53:48.860356 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 707/1408] 10.222.0.55 () {58 vars in 1039 bytes} [Tue May 3 09:53:48 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:53:48.870448 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268c430-401d-4241-8a5a-d349a1744653 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:53:48.890009 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268c430-401d-4241-8a5a-d349a1744653 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:53:48.896097 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d8e75-736f-41b3-8e05-8c3ab7403ef9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73dfc1b485d647f1ae59a405c978599f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:53:48.896729 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d8e75-736f-41b3-8e05-8c3ab7403ef9 service swift] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:53:48.897004 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d8e75-736f-41b3-8e05-8c3ab7403ef9 service swift] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:53:48.897263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d8e75-736f-41b3-8e05-8c3ab7403ef9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:53:48.906268 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d8e75-736f-41b3-8e05-8c3ab7403ef9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:53:48.907835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d8e75-736f-41b3-8e05-8c3ab7403ef9 service swift] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:53:48.915972 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 702/1409] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 3 09:53:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 09:54:12.134129 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7320d-4f48-4275-949d-1bff57538e3f None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:12.134838 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7320d-4f48-4275-949d-1bff57538e3f None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:12.134838 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7320d-4f48-4275-949d-1bff57538e3f None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:12.136054 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 708/1410] 10.222.0.55 () {54 vars in 918 bytes} [Tue May 3 09:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:12.142435 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41b45f-3f05-42b5-9300-186e37e60a76 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:12.142949 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41b45f-3f05-42b5-9300-186e37e60a76 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:12.142949 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41b45f-3f05-42b5-9300-186e37e60a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:12.167817 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-dd41b45f-3f05-42b5-9300-186e37e60a76 None None] MFA Rules not processed for user `26bee0f9d8c341fca8290b2fbc95e1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:12.168998 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-dd41b45f-3f05-42b5-9300-186e37e60a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:12.177781 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 703/1411] 10.222.0.55 () {58 vars in 1015 bytes} [Tue May 3 09:54:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:12.191919 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07517c-56a5-4e2d-8e0d-5c85d5e62239 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:12.192182 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07517c-56a5-4e2d-8e0d-5c85d5e62239 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:12.192458 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07517c-56a5-4e2d-8e0d-5c85d5e62239 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:12.194063 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 709/1412] 10.222.0.55 () {54 vars in 918 bytes} [Tue May 3 09:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:12.199048 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e379b7-8987-44bc-a7f5-78cff9b9eb00 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:12.199335 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e379b7-8987-44bc-a7f5-78cff9b9eb00 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:12.199611 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e379b7-8987-44bc-a7f5-78cff9b9eb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:12.216923 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-75e379b7-8987-44bc-a7f5-78cff9b9eb00 None None] MFA Rules not processed for user `efb008cfc6424998917da60d72689f55`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:12.218134 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-75e379b7-8987-44bc-a7f5-78cff9b9eb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:12.227831 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 704/1413] 10.222.0.55 () {58 vars in 1015 bytes} [Tue May 3 09:54:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:14.923644 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a81ae-fe23-4883-a0b3-d58c9e6c9be0 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:14.924648 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a81ae-fe23-4883-a0b3-d58c9e6c9be0 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:14.924648 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a81ae-fe23-4883-a0b3-d58c9e6c9be0 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:14.926610 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:54:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:14.932610 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a20b-85fb-47ca-b4ac-55594111d8cd None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:14.933063 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a20b-85fb-47ca-b4ac-55594111d8cd None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:14.933175 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a20b-85fb-47ca-b4ac-55594111d8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:14.953422 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-3241a20b-85fb-47ca-b4ac-55594111d8cd None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:14.954660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-3241a20b-85fb-47ca-b4ac-55594111d8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:14.964186 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:15.008630 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a81ae-fe23-4883-a0b3-d58c9e6c9be0 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:15.033749 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a81ae-fe23-4883-a0b3-d58c9e6c9be0 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:15.041897 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58b47f-7d48-46d0-b045-488837971f44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:15.042532 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58b47f-7d48-46d0-b045-488837971f44 service nova] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:15.042812 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58b47f-7d48-46d0-b045-488837971f44 service nova] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:15.043083 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58b47f-7d48-46d0-b045-488837971f44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:15.051453 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58b47f-7d48-46d0-b045-488837971f44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:15.053029 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58b47f-7d48-46d0-b045-488837971f44 service nova] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:15.062340 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 711/1416] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:54:16.345303 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48d11b-2ba7-4a22-b511-9827843bd942 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:16.346234 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48d11b-2ba7-4a22-b511-9827843bd942 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:16.346234 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48d11b-2ba7-4a22-b511-9827843bd942 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:16.348428 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:54:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:16.356358 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697a9be-1937-4f3e-9071-1049cf000735 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:16.357106 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697a9be-1937-4f3e-9071-1049cf000735 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:16.357254 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697a9be-1937-4f3e-9071-1049cf000735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:16.379313 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-f697a9be-1937-4f3e-9071-1049cf000735 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:16.380488 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-f697a9be-1937-4f3e-9071-1049cf000735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:16.390269 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:16.563291 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48d11b-2ba7-4a22-b511-9827843bd942 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:16.580678 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48d11b-2ba7-4a22-b511-9827843bd942 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:16.586829 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751a060-4939-41a9-9908-a0cf6b1451f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:16.587458 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751a060-4939-41a9-9908-a0cf6b1451f1 service nova] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:16.587735 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751a060-4939-41a9-9908-a0cf6b1451f1 service nova] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:16.588005 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751a060-4939-41a9-9908-a0cf6b1451f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:16.596412 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751a060-4939-41a9-9908-a0cf6b1451f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:16.598081 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751a060-4939-41a9-9908-a0cf6b1451f1 service nova] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:16.607758 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 707/1419] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:54:17.856284 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ea45f-94b3-4657-a16c-baef80da8f64 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:17.857274 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ea45f-94b3-4657-a16c-baef80da8f64 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:17.857274 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ea45f-94b3-4657-a16c-baef80da8f64 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:17.859386 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:54:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:17.865382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729559fb-4b6d-487e-b924-be7de378270d None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:17.865851 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729559fb-4b6d-487e-b924-be7de378270d None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:17.866143 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729559fb-4b6d-487e-b924-be7de378270d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:17.885948 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-729559fb-4b6d-487e-b924-be7de378270d None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:17.887139 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-729559fb-4b6d-487e-b924-be7de378270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:17.897530 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:18.048994 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ea45f-94b3-4657-a16c-baef80da8f64 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:18.065491 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ea45f-94b3-4657-a16c-baef80da8f64 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:18.072186 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940970d8-5c56-4072-92a9-361e4f193a1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:18.072809 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940970d8-5c56-4072-92a9-361e4f193a1b service nova] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:18.073082 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940970d8-5c56-4072-92a9-361e4f193a1b service nova] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:18.073350 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940970d8-5c56-4072-92a9-361e4f193a1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:18.081509 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940970d8-5c56-4072-92a9-361e4f193a1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:18.083109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940970d8-5c56-4072-92a9-361e4f193a1b service nova] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:18.092335 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 714/1422] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 09:54:19.325071 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5004af-3dd3-45ef-84ab-320789f3a905 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:19.325630 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5004af-3dd3-45ef-84ab-320789f3a905 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:19.325630 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5004af-3dd3-45ef-84ab-320789f3a905 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:19.327024 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:54:19.332180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4726f3-2650-48f2-94cf-a4a9ea576a57 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:19.332633 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4726f3-2650-48f2-94cf-a4a9ea576a57 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:19.332736 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4726f3-2650-48f2-94cf-a4a9ea576a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:19.352335 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-5c4726f3-2650-48f2-94cf-a4a9ea576a57 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:19.353530 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-5c4726f3-2650-48f2-94cf-a4a9ea576a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:19.362526 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:19.514785 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5004af-3dd3-45ef-84ab-320789f3a905 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:19.538696 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5004af-3dd3-45ef-84ab-320789f3a905 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:19.545327 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc948b-5c82-438a-9f81-7814f7baa02e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:19.545928 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc948b-5c82-438a-9f81-7814f7baa02e service nova] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:19.546206 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc948b-5c82-438a-9f81-7814f7baa02e service nova] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:19.546497 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc948b-5c82-438a-9f81-7814f7baa02e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:19.555058 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc948b-5c82-438a-9f81-7814f7baa02e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:19.556623 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc948b-5c82-438a-9f81-7814f7baa02e service nova] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:19.566236 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 710/1425] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:54:20.798512 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e8c7d-44a7-4493-b8ce-78b75c3577e8 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:20.799418 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e8c7d-44a7-4493-b8ce-78b75c3577e8 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:20.799418 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e8c7d-44a7-4493-b8ce-78b75c3577e8 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:20.801638 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:54:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:20.806803 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237a615-c732-412a-8fc1-593e83a55bf3 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:20.807273 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237a615-c732-412a-8fc1-593e83a55bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:20.808711 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237a615-c732-412a-8fc1-593e83a55bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:20.826703 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-c237a615-c732-412a-8fc1-593e83a55bf3 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:20.827875 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-c237a615-c732-412a-8fc1-593e83a55bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:20.836998 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:20.987736 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e8c7d-44a7-4493-b8ce-78b75c3577e8 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:21.011796 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e8c7d-44a7-4493-b8ce-78b75c3577e8 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:21.019408 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28928c4-848e-4e1e-ac6e-8d418d7a0738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:21.020052 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28928c4-848e-4e1e-ac6e-8d418d7a0738 service nova] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:21.020331 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28928c4-848e-4e1e-ac6e-8d418d7a0738 service nova] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:21.020607 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28928c4-848e-4e1e-ac6e-8d418d7a0738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:21.029299 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28928c4-848e-4e1e-ac6e-8d418d7a0738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:21.030926 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28928c4-848e-4e1e-ac6e-8d418d7a0738 service nova] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:21.040649 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 717/1428] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:54:22.237720 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96648b87-4fab-4ca3-adf3-dc61a3d04b15 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:22.238341 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96648b87-4fab-4ca3-adf3-dc61a3d04b15 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:22.238341 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96648b87-4fab-4ca3-adf3-dc61a3d04b15 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:22.239679 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:22.246121 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c76e4-43a0-43d9-b1cb-1bfb3dd8fb1b None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:22.246783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c76e4-43a0-43d9-b1cb-1bfb3dd8fb1b None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:22.246904 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c76e4-43a0-43d9-b1cb-1bfb3dd8fb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:22.270839 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-265c76e4-43a0-43d9-b1cb-1bfb3dd8fb1b None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:22.272369 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-265c76e4-43a0-43d9-b1cb-1bfb3dd8fb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:22.280825 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:22.431743 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96648b87-4fab-4ca3-adf3-dc61a3d04b15 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:22.448564 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96648b87-4fab-4ca3-adf3-dc61a3d04b15 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:22.454374 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718d49d-8dc0-491f-86bb-41a545557357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:22.455001 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718d49d-8dc0-491f-86bb-41a545557357 service nova] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:22.455275 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718d49d-8dc0-491f-86bb-41a545557357 service nova] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:22.455546 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718d49d-8dc0-491f-86bb-41a545557357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:22.463640 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718d49d-8dc0-491f-86bb-41a545557357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:22.465195 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718d49d-8dc0-491f-86bb-41a545557357 service nova] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:22.475000 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 713/1431] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:54:23.675841 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459270c6-cf25-41dc-8b57-3e6596fc9805 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:23.676397 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459270c6-cf25-41dc-8b57-3e6596fc9805 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:23.676397 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459270c6-cf25-41dc-8b57-3e6596fc9805 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:23.677782 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:23.683706 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb28f65-8dfa-46fd-a6aa-c8c664c46979 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:23.684148 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb28f65-8dfa-46fd-a6aa-c8c664c46979 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:23.684239 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb28f65-8dfa-46fd-a6aa-c8c664c46979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:23.705455 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-bcb28f65-8dfa-46fd-a6aa-c8c664c46979 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:23.706702 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-bcb28f65-8dfa-46fd-a6aa-c8c664c46979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:23.715223 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:23.863507 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459270c6-cf25-41dc-8b57-3e6596fc9805 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:23.886015 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459270c6-cf25-41dc-8b57-3e6596fc9805 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:23.896590 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c837b40-7f69-4823-8aff-10ff203f7a86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:23.897259 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c837b40-7f69-4823-8aff-10ff203f7a86 service nova] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:23.897527 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c837b40-7f69-4823-8aff-10ff203f7a86 service nova] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:23.897769 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c837b40-7f69-4823-8aff-10ff203f7a86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:23.906227 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c837b40-7f69-4823-8aff-10ff203f7a86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:23.907840 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c837b40-7f69-4823-8aff-10ff203f7a86 service nova] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:23.917359 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 720/1434] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:54:25.131167 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb110507-fb6b-4cf2-9e21-279d5f645af6 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:25.132205 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb110507-fb6b-4cf2-9e21-279d5f645af6 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:25.132205 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb110507-fb6b-4cf2-9e21-279d5f645af6 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:25.134173 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:54:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:25.140608 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c45f27-0eaa-480b-b31d-07961a4c4deb None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:25.141049 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c45f27-0eaa-480b-b31d-07961a4c4deb None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:25.141303 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c45f27-0eaa-480b-b31d-07961a4c4deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:25.163047 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-e2c45f27-0eaa-480b-b31d-07961a4c4deb None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:25.164230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-e2c45f27-0eaa-480b-b31d-07961a4c4deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:25.172550 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:25.324008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb110507-fb6b-4cf2-9e21-279d5f645af6 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:25.341222 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb110507-fb6b-4cf2-9e21-279d5f645af6 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:25.347545 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806d0aa-2c70-44e6-a35c-79619c928547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:25.348170 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806d0aa-2c70-44e6-a35c-79619c928547 service nova] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:25.348444 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806d0aa-2c70-44e6-a35c-79619c928547 service nova] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:25.348712 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806d0aa-2c70-44e6-a35c-79619c928547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:25.356949 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806d0aa-2c70-44e6-a35c-79619c928547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:25.358550 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806d0aa-2c70-44e6-a35c-79619c928547 service nova] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:25.367827 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 716/1437] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:54:26.559406 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d196d-78d5-43d1-a599-77eba60a2c91 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:26.560270 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d196d-78d5-43d1-a599-77eba60a2c91 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:26.560270 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d196d-78d5-43d1-a599-77eba60a2c91 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:26.562584 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 09:54:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:26.569976 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbce23-fe63-4fb0-ba89-15b518355056 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:26.570392 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbce23-fe63-4fb0-ba89-15b518355056 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:26.570533 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbce23-fe63-4fb0-ba89-15b518355056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:26.589546 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-3adbce23-fe63-4fb0-ba89-15b518355056 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:26.590757 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-3adbce23-fe63-4fb0-ba89-15b518355056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:26.600155 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 09:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:26.750793 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d196d-78d5-43d1-a599-77eba60a2c91 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:26.767568 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d196d-78d5-43d1-a599-77eba60a2c91 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:26.774224 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2ac78-2e93-44dd-b6ba-5f7605c7e9d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:26.774853 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2ac78-2e93-44dd-b6ba-5f7605c7e9d4 service nova] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:26.775131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2ac78-2e93-44dd-b6ba-5f7605c7e9d4 service nova] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:26.775397 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2ac78-2e93-44dd-b6ba-5f7605c7e9d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:26.783538 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2ac78-2e93-44dd-b6ba-5f7605c7e9d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:26.785109 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2ac78-2e93-44dd-b6ba-5f7605c7e9d4 service nova] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:26.794310 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 723/1440] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:54:28.919246 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1d254-b93e-425c-9583-a26d57911b0a None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:28.919856 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1d254-b93e-425c-9583-a26d57911b0a None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:28.919856 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1d254-b93e-425c-9583-a26d57911b0a None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:28.921172 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:28.926708 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592ec70-e472-46a3-91a4-8f059fad333d None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:28.927139 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592ec70-e472-46a3-91a4-8f059fad333d None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:28.927238 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592ec70-e472-46a3-91a4-8f059fad333d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:28.949938 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-a592ec70-e472-46a3-91a4-8f059fad333d None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:28.951745 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-a592ec70-e472-46a3-91a4-8f059fad333d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:28.963762 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:29.005372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1d254-b93e-425c-9583-a26d57911b0a None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:29.022475 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1d254-b93e-425c-9583-a26d57911b0a None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:29.026174 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd68687-e8f9-4211-aba3-487a95b9fc92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:29.026838 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd68687-e8f9-4211-aba3-487a95b9fc92 service neutron] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:29.027115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd68687-e8f9-4211-aba3-487a95b9fc92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:29.027384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd68687-e8f9-4211-aba3-487a95b9fc92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:29.036304 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd68687-e8f9-4211-aba3-487a95b9fc92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:29.038025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd68687-e8f9-4211-aba3-487a95b9fc92 service neutron] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:29.046850 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 719/1443] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:54:31.583820 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665f632-6f92-4a3d-9cff-0c0fd838ec56 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:31.584383 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665f632-6f92-4a3d-9cff-0c0fd838ec56 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:31.584497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665f632-6f92-4a3d-9cff-0c0fd838ec56 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:31.585891 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:54:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 09:54:31.591545 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3468-f40f-4ebd-b42c-0f0ceaa96777 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:31.591989 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3468-f40f-4ebd-b42c-0f0ceaa96777 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:31.592102 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3468-f40f-4ebd-b42c-0f0ceaa96777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:31.612106 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-bedc3468-f40f-4ebd-b42c-0f0ceaa96777 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:31.613284 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-bedc3468-f40f-4ebd-b42c-0f0ceaa96777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:31.622660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:31.661992 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665f632-6f92-4a3d-9cff-0c0fd838ec56 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:31.675468 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665f632-6f92-4a3d-9cff-0c0fd838ec56 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:31.680292 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf1f20-5206-4040-8b4e-ff2bb137f08a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:31.680939 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf1f20-5206-4040-8b4e-ff2bb137f08a service neutron] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:31.681216 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf1f20-5206-4040-8b4e-ff2bb137f08a service neutron] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:31.681485 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf1f20-5206-4040-8b4e-ff2bb137f08a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:31.695062 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf1f20-5206-4040-8b4e-ff2bb137f08a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:31.696484 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf1f20-5206-4040-8b4e-ff2bb137f08a service neutron] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:31.706662 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 726/1446] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:54:34.257569 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92670-6b94-4008-a5eb-e69009a94abf None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:34.258263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92670-6b94-4008-a5eb-e69009a94abf None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:34.258263 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92670-6b94-4008-a5eb-e69009a94abf None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:34.259503 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:34.265819 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89329d4a-2ed6-427f-9230-2def8eb08916 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:34.266900 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89329d4a-2ed6-427f-9230-2def8eb08916 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:34.266900 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89329d4a-2ed6-427f-9230-2def8eb08916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:34.286940 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-89329d4a-2ed6-427f-9230-2def8eb08916 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:34.288095 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-89329d4a-2ed6-427f-9230-2def8eb08916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:34.299116 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:34.338716 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac92670-6b94-4008-a5eb-e69009a94abf None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:34.352099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac92670-6b94-4008-a5eb-e69009a94abf None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:34.356870 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b26625-31fd-4656-be4f-6881fd7a5e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:34.357514 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b26625-31fd-4656-be4f-6881fd7a5e2a service neutron] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:34.357814 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b26625-31fd-4656-be4f-6881fd7a5e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:34.358092 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b26625-31fd-4656-be4f-6881fd7a5e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:34.368279 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b26625-31fd-4656-be4f-6881fd7a5e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:34.369715 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b26625-31fd-4656-be4f-6881fd7a5e2a service neutron] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:34.379117 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 722/1449] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:54:36.798624 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35326cae-9946-41f3-bc67-b62fb9923144 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:36.799213 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35326cae-9946-41f3-bc67-b62fb9923144 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:36.799213 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35326cae-9946-41f3-bc67-b62fb9923144 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:36.800595 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:36.806938 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b9a42-4480-432b-8a83-9807179cf8a1 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:36.807392 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b9a42-4480-432b-8a83-9807179cf8a1 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:36.807508 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b9a42-4480-432b-8a83-9807179cf8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:36.830075 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-4f9b9a42-4480-432b-8a83-9807179cf8a1 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:36.831259 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-4f9b9a42-4480-432b-8a83-9807179cf8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:36.839699 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:36.884624 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35326cae-9946-41f3-bc67-b62fb9923144 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:36.897316 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35326cae-9946-41f3-bc67-b62fb9923144 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:36.901641 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b8281-03f8-41a1-89b6-687f74ac5c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:36.902310 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b8281-03f8-41a1-89b6-687f74ac5c04 service neutron] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:36.902587 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b8281-03f8-41a1-89b6-687f74ac5c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:36.902854 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b8281-03f8-41a1-89b6-687f74ac5c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:36.912698 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b8281-03f8-41a1-89b6-687f74ac5c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:36.914159 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b8281-03f8-41a1-89b6-687f74ac5c04 service neutron] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:36.923461 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 729/1452] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:54:39.281003 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2715a2-8815-4d36-ae10-1a9a6b8ae4d6 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:39.281559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2715a2-8815-4d36-ae10-1a9a6b8ae4d6 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:39.281559 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2715a2-8815-4d36-ae10-1a9a6b8ae4d6 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:39.283184 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:39.288964 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c813351-9c50-4ec7-9189-337c16c0cbc5 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:39.289364 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c813351-9c50-4ec7-9189-337c16c0cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:39.289580 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c813351-9c50-4ec7-9189-337c16c0cbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:39.316855 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-2c813351-9c50-4ec7-9189-337c16c0cbc5 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:39.318281 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-2c813351-9c50-4ec7-9189-337c16c0cbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:39.327497 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:39.368394 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2715a2-8815-4d36-ae10-1a9a6b8ae4d6 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:39.386178 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2715a2-8815-4d36-ae10-1a9a6b8ae4d6 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:39.393450 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d8f5e-a007-4d04-9437-9d8779e64b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:39.394486 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d8f5e-a007-4d04-9437-9d8779e64b52 service neutron] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:39.394855 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d8f5e-a007-4d04-9437-9d8779e64b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:39.395191 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d8f5e-a007-4d04-9437-9d8779e64b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:39.404892 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d8f5e-a007-4d04-9437-9d8779e64b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:39.406345 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d8f5e-a007-4d04-9437-9d8779e64b52 service neutron] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:39.415986 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 725/1455] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:54:41.676245 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a16fb8-c17e-4f96-b619-0fcdd1abf799 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:41.676900 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a16fb8-c17e-4f96-b619-0fcdd1abf799 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:41.676900 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a16fb8-c17e-4f96-b619-0fcdd1abf799 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:41.678247 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:41.683664 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68631509-af3b-4ff8-b1fc-bb8975e2950a None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:41.684147 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68631509-af3b-4ff8-b1fc-bb8975e2950a None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:41.684256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68631509-af3b-4ff8-b1fc-bb8975e2950a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:41.708591 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-68631509-af3b-4ff8-b1fc-bb8975e2950a None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:41.709759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-68631509-af3b-4ff8-b1fc-bb8975e2950a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:41.718919 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:41.760275 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a16fb8-c17e-4f96-b619-0fcdd1abf799 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:41.776389 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a16fb8-c17e-4f96-b619-0fcdd1abf799 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:41.780053 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2bdbc-f807-42f8-b6e1-091ea79cc3af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:41.780680 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2bdbc-f807-42f8-b6e1-091ea79cc3af service neutron] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:41.780992 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2bdbc-f807-42f8-b6e1-091ea79cc3af service neutron] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:41.781256 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2bdbc-f807-42f8-b6e1-091ea79cc3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:41.790188 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2bdbc-f807-42f8-b6e1-091ea79cc3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:41.791600 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2bdbc-f807-42f8-b6e1-091ea79cc3af service neutron] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:41.800825 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 732/1458] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:54:44.081205 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0be0-0ce3-4fe8-8ff1-28643d490b43 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:44.082158 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0be0-0ce3-4fe8-8ff1-28643d490b43 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:44.082158 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0be0-0ce3-4fe8-8ff1-28643d490b43 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:44.083903 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:54:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:44.089332 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7aef7-491f-4ec7-a6db-1000d1bf23cc None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:44.089787 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7aef7-491f-4ec7-a6db-1000d1bf23cc None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:44.089932 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7aef7-491f-4ec7-a6db-1000d1bf23cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:44.108956 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-dff7aef7-491f-4ec7-a6db-1000d1bf23cc None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:44.110180 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-dff7aef7-491f-4ec7-a6db-1000d1bf23cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:44.119419 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:44.159409 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f0be0-0ce3-4fe8-8ff1-28643d490b43 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:44.178151 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f0be0-0ce3-4fe8-8ff1-28643d490b43 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:44.182807 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b43089-8beb-4928-97a4-d622084faa32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:44.183440 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b43089-8beb-4928-97a4-d622084faa32 service neutron] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:44.183683 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b43089-8beb-4928-97a4-d622084faa32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:44.183973 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b43089-8beb-4928-97a4-d622084faa32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:44.197064 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b43089-8beb-4928-97a4-d622084faa32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:44.199344 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b43089-8beb-4928-97a4-d622084faa32 service neutron] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:44.212029 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 728/1461] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:54:46.492456 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ee8ce-8c88-4fbe-875b-18ad4aad4ef3 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:46.493261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ee8ce-8c88-4fbe-875b-18ad4aad4ef3 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:46.493261 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ee8ce-8c88-4fbe-875b-18ad4aad4ef3 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:46.495419 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:54:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:46.503786 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce88eab-9393-46ae-b691-ea5cb976e661 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:46.504234 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce88eab-9393-46ae-b691-ea5cb976e661 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:46.504330 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce88eab-9393-46ae-b691-ea5cb976e661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:46.523474 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-4ce88eab-9393-46ae-b691-ea5cb976e661 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:46.524654 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-4ce88eab-9393-46ae-b691-ea5cb976e661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:46.533091 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:46.572006 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ee8ce-8c88-4fbe-875b-18ad4aad4ef3 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:46.590223 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ee8ce-8c88-4fbe-875b-18ad4aad4ef3 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:46.596805 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a0ad1-6ca4-4b36-b5f5-c089586e9395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:46.597756 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a0ad1-6ca4-4b36-b5f5-c089586e9395 service neutron] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:46.598098 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a0ad1-6ca4-4b36-b5f5-c089586e9395 service neutron] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:46.598633 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a0ad1-6ca4-4b36-b5f5-c089586e9395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:46.608852 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a0ad1-6ca4-4b36-b5f5-c089586e9395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:46.610317 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a0ad1-6ca4-4b36-b5f5-c089586e9395 service neutron] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:46.620089 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 735/1464] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:54:48.997542 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607235b-ed1b-43e0-982a-5fb7b2973107 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:48.998055 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607235b-ed1b-43e0-982a-5fb7b2973107 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:48.998163 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607235b-ed1b-43e0-982a-5fb7b2973107 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:48.999511 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:49.006940 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c63c71-0327-4e4f-b62c-1750061504f8 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:49.007412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c63c71-0327-4e4f-b62c-1750061504f8 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:49.007412 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c63c71-0327-4e4f-b62c-1750061504f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:49.027891 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-b6c63c71-0327-4e4f-b62c-1750061504f8 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:49.029214 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-b6c63c71-0327-4e4f-b62c-1750061504f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:49.041319 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:49.080575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607235b-ed1b-43e0-982a-5fb7b2973107 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:49.093158 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607235b-ed1b-43e0-982a-5fb7b2973107 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:49.100161 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd70fa-cd06-4ed6-919a-7c3e2de56a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:49.100835 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd70fa-cd06-4ed6-919a-7c3e2de56a63 service neutron] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:49.101108 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd70fa-cd06-4ed6-919a-7c3e2de56a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:49.101382 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd70fa-cd06-4ed6-919a-7c3e2de56a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:49.111558 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd70fa-cd06-4ed6-919a-7c3e2de56a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:49.112998 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd70fa-cd06-4ed6-919a-7c3e2de56a63 service neutron] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:49.123782 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 731/1467] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:54:51.345317 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4e408-1a05-41a1-af84-3de23ef5d575 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:51.346327 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4e408-1a05-41a1-af84-3de23ef5d575 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:51.346327 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4e408-1a05-41a1-af84-3de23ef5d575 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:51.348486 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 09:54:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:54:51.354135 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb5e8b-c6ad-44d2-a0b9-4823115c8cfa None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:51.354578 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb5e8b-c6ad-44d2-a0b9-4823115c8cfa None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:51.354681 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb5e8b-c6ad-44d2-a0b9-4823115c8cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:51.374888 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-a1cb5e8b-c6ad-44d2-a0b9-4823115c8cfa None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:54:51.376637 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-a1cb5e8b-c6ad-44d2-a0b9-4823115c8cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:54:51.390669 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 09:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:54:51.428884 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4e408-1a05-41a1-af84-3de23ef5d575 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:54:51.446457 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4e408-1a05-41a1-af84-3de23ef5d575 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:54:51.453166 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fd6db-2e97-4f28-9373-63f1eff1e17b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:54:51.454113 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fd6db-2e97-4f28-9373-63f1eff1e17b service neutron] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:54:51.454467 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fd6db-2e97-4f28-9373-63f1eff1e17b service neutron] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:54:51.454762 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fd6db-2e97-4f28-9373-63f1eff1e17b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:54:51.466432 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fd6db-2e97-4f28-9373-63f1eff1e17b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:54:51.467864 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fd6db-2e97-4f28-9373-63f1eff1e17b service neutron] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:54:51.478042 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 738/1470] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:55:24.399371 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0796268-0ce6-4298-9294-7ec62a518927 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:24.400032 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0796268-0ce6-4298-9294-7ec62a518927 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:24.400032 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0796268-0ce6-4298-9294-7ec62a518927 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:24.401272 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 733/1471] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:55:24.410024 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b206b-6698-4735-9d8a-940ae8796529 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:24.410477 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b206b-6698-4735-9d8a-940ae8796529 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:24.410585 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b206b-6698-4735-9d8a-940ae8796529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:24.429200 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-409b206b-6698-4735-9d8a-940ae8796529 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:55:24.430399 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-409b206b-6698-4735-9d8a-940ae8796529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:55:24.438988 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 739/1472] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:55:24.488979 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7195c-ff5a-436b-9ecf-686c4b4f954b None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:24.489324 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7195c-ff5a-436b-9ecf-686c4b4f954b None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:24.489660 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7195c-ff5a-436b-9ecf-686c4b4f954b None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:24.491759 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 734/1473] 10.222.0.55 () {54 vars in 962 bytes} [Tue May 3 09:55:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:55:24.496709 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616bd5-3381-4bff-be54-acec4915495f None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:24.496996 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616bd5-3381-4bff-be54-acec4915495f None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:24.497269 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616bd5-3381-4bff-be54-acec4915495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:24.516153 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-f0616bd5-3381-4bff-be54-acec4915495f None None] MFA Rules not processed for user `d5b508ac957b4224912fbc2c2f1ea324`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:55:24.517319 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-f0616bd5-3381-4bff-be54-acec4915495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:55:24.524749 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 740/1474] 10.222.0.55 () {58 vars in 1059 bytes} [Tue May 3 09:55:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:55:24.532314 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7195c-ff5a-436b-9ecf-686c4b4f954b None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:55:24.545557 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7195c-ff5a-436b-9ecf-686c4b4f954b None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:55:24.550127 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e54371-55c8-4adc-9535-1b77a66cbe81 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b508ac957b4224912fbc2c2f1ea324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:55:24.550845 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e54371-55c8-4adc-9535-1b77a66cbe81 service glance] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:24.551118 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e54371-55c8-4adc-9535-1b77a66cbe81 service glance] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:24.551387 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e54371-55c8-4adc-9535-1b77a66cbe81 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:24.561099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e54371-55c8-4adc-9535-1b77a66cbe81 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:55:24.562575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e54371-55c8-4adc-9535-1b77a66cbe81 service glance] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:55:24.573097 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 735/1475] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:55:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:55:26.899861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a62d0-2614-462c-aa1b-7ba77da8679c None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:26.900705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a62d0-2614-462c-aa1b-7ba77da8679c None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:26.900705 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a62d0-2614-462c-aa1b-7ba77da8679c None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:26.903019 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 741/1476] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:55:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:55:26.909258 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cd335-5a12-412b-aea3-975169bee6ab None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:26.909721 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cd335-5a12-412b-aea3-975169bee6ab None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:26.909905 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cd335-5a12-412b-aea3-975169bee6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:26.928256 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-953cd335-5a12-412b-aea3-975169bee6ab None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:55:26.929432 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-953cd335-5a12-412b-aea3-975169bee6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:55:26.939077 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 736/1477] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:55:26.962160 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a62d0-2614-462c-aa1b-7ba77da8679c None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:55:26.976638 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a62d0-2614-462c-aa1b-7ba77da8679c None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:55:26.982521 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b3df9-bb70-42bd-b55c-2f58002adcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4434afe425d5493fb9f74ff63598d4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:55:26.983173 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b3df9-bb70-42bd-b55c-2f58002adcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:26.983459 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b3df9-bb70-42bd-b55c-2f58002adcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:26.983734 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b3df9-bb70-42bd-b55c-2f58002adcc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:26.984477 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b3df9-bb70-42bd-b55c-2f58002adcc6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:55:26.986324 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: WARNING py.warnings [None req-7d1b3df9-bb70-42bd-b55c-2f58002adcc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 09:55:26.986324 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: warnings.warn(msg) May 03 09:55:26.986324 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: May 03 09:55:26.987628 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b3df9-bb70-42bd-b55c-2f58002adcc6 admin admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:55:27.007240 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 742/1478] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 3 09:55:26 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:55:29.240717 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e072f5f-aeb8-4a9a-b1ff-9914e92f5227 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:29.241277 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e072f5f-aeb8-4a9a-b1ff-9914e92f5227 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:29.241277 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e072f5f-aeb8-4a9a-b1ff-9914e92f5227 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:29.242663 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 737/1479] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:55:29.248166 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d8626-dd28-49fb-b084-f2a6bb31e841 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:29.248607 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d8626-dd28-49fb-b084-f2a6bb31e841 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:29.248711 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d8626-dd28-49fb-b084-f2a6bb31e841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:29.268706 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-ef6d8626-dd28-49fb-b084-f2a6bb31e841 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:55:29.269808 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-ef6d8626-dd28-49fb-b084-f2a6bb31e841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:55:29.277983 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 743/1480] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:55:29.324555 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e072f5f-aeb8-4a9a-b1ff-9914e92f5227 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:55:29.342665 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e072f5f-aeb8-4a9a-b1ff-9914e92f5227 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:55:29.349883 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf66ac-784d-4120-827e-f0ef2a6ffbaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:55:29.350458 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf66ac-784d-4120-827e-f0ef2a6ffbaa service nova] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:29.350738 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf66ac-784d-4120-827e-f0ef2a6ffbaa service nova] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:29.350996 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf66ac-784d-4120-827e-f0ef2a6ffbaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:29.360705 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf66ac-784d-4120-827e-f0ef2a6ffbaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:55:29.362694 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf66ac-784d-4120-827e-f0ef2a6ffbaa service nova] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:55:29.373918 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 738/1481] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:55:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:55:31.783941 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267085c-2312-4f1e-9153-a78298639067 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:31.784511 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267085c-2312-4f1e-9153-a78298639067 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:31.784511 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267085c-2312-4f1e-9153-a78298639067 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:31.785872 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 744/1482] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:55:31.791495 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22003c5-7b5b-4875-87c8-5d49944ccd91 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:31.791930 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22003c5-7b5b-4875-87c8-5d49944ccd91 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:31.792047 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22003c5-7b5b-4875-87c8-5d49944ccd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:31.811252 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-c22003c5-7b5b-4875-87c8-5d49944ccd91 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:55:31.812435 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-c22003c5-7b5b-4875-87c8-5d49944ccd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:55:31.821756 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 739/1483] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:55:31.858523 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267085c-2312-4f1e-9153-a78298639067 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:55:31.872024 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267085c-2312-4f1e-9153-a78298639067 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:55:31.876256 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f423d8-2f34-42e0-9637-7ef821f4fdce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:55:31.876897 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f423d8-2f34-42e0-9637-7ef821f4fdce service neutron] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:31.877165 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f423d8-2f34-42e0-9637-7ef821f4fdce service neutron] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:31.877430 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f423d8-2f34-42e0-9637-7ef821f4fdce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:31.887447 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f423d8-2f34-42e0-9637-7ef821f4fdce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:55:31.888873 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f423d8-2f34-42e0-9637-7ef821f4fdce service neutron] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:55:31.898196 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 745/1484] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:55:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:55:34.238925 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf609ea7-60fb-403e-867c-0dd940326bd4 None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:34.239618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf609ea7-60fb-403e-867c-0dd940326bd4 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:34.239618 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf609ea7-60fb-403e-867c-0dd940326bd4 None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:34.240828 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 740/1485] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:55:34.246400 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bf104-017a-4d84-aa06-227a095ab98e None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:34.246893 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bf104-017a-4d84-aa06-227a095ab98e None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:34.246893 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bf104-017a-4d84-aa06-227a095ab98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:34.267616 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-3a3bf104-017a-4d84-aa06-227a095ab98e None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:55:34.268929 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-3a3bf104-017a-4d84-aa06-227a095ab98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:55:34.279477 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 746/1486] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:55:34.321134 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf609ea7-60fb-403e-867c-0dd940326bd4 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:55:34.334917 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf609ea7-60fb-403e-867c-0dd940326bd4 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:55:34.341536 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94115e82-6373-45dd-9113-5b343393ee44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:55:34.342575 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94115e82-6373-45dd-9113-5b343393ee44 service neutron] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:34.343217 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94115e82-6373-45dd-9113-5b343393ee44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:34.343716 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94115e82-6373-45dd-9113-5b343393ee44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:34.358049 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94115e82-6373-45dd-9113-5b343393ee44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:55:34.359608 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94115e82-6373-45dd-9113-5b343393ee44 service neutron] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:55:34.369757 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 741/1487] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:55:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:55:36.677121 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50680fe9-9b33-43e9-9d86-4b364910a1a6 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:36.678012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50680fe9-9b33-43e9-9d86-4b364910a1a6 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:36.678012 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50680fe9-9b33-43e9-9d86-4b364910a1a6 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:36.680181 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 747/1488] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:55:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:55:36.685534 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f880043-df0f-4c1e-a050-b458470fc75a None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:36.686007 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f880043-df0f-4c1e-a050-b458470fc75a None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:36.686115 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f880043-df0f-4c1e-a050-b458470fc75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:36.704363 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-9f880043-df0f-4c1e-a050-b458470fc75a None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:55:36.705569 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-9f880043-df0f-4c1e-a050-b458470fc75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:55:36.714001 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 742/1489] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:55:36.757212 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50680fe9-9b33-43e9-9d86-4b364910a1a6 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:55:36.773153 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50680fe9-9b33-43e9-9d86-4b364910a1a6 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:55:36.777457 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b60255-f8a7-46f9-a8ed-1a2a1d50ad1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:55:36.778132 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b60255-f8a7-46f9-a8ed-1a2a1d50ad1a service neutron] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:36.778404 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b60255-f8a7-46f9-a8ed-1a2a1d50ad1a service neutron] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:36.778698 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b60255-f8a7-46f9-a8ed-1a2a1d50ad1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:36.788499 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b60255-f8a7-46f9-a8ed-1a2a1d50ad1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:55:36.789991 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b60255-f8a7-46f9-a8ed-1a2a1d50ad1a service neutron] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:55:36.799045 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 748/1490] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:55:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:55:39.181586 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958cc9f-3945-4085-8b2b-e159446023fa None None] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:39.182213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958cc9f-3945-4085-8b2b-e159446023fa None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:39.182213 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958cc9f-3945-4085-8b2b-e159446023fa None None] PATH_INFO: `/` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:39.183517 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 743/1491] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 3 09:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:55:39.188783 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a358c-0f8d-4a92-bb7c-4d63ebcdf7ba None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:39.189230 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a358c-0f8d-4a92-bb7c-4d63ebcdf7ba None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:39.189343 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a358c-0f8d-4a92-bb7c-4d63ebcdf7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:39.208754 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-e73a358c-0f8d-4a92-bb7c-4d63ebcdf7ba None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:55:39.209984 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-e73a358c-0f8d-4a92-bb7c-4d63ebcdf7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:55:39.218244 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 749/1492] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 3 09:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:55:39.256959 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958cc9f-3945-4085-8b2b-e159446023fa None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:55:39.269430 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958cc9f-3945-4085-8b2b-e159446023fa None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:55:39.273462 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af440ff-efcd-4a17-aded-a3ed153ac5b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:55:39.274126 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af440ff-efcd-4a17-aded-a3ed153ac5b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:55:39.274405 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af440ff-efcd-4a17-aded-a3ed153ac5b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:55:39.274673 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af440ff-efcd-4a17-aded-a3ed153ac5b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:55:39.283990 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af440ff-efcd-4a17-aded-a3ed153ac5b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:55:39.285541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af440ff-efcd-4a17-aded-a3ed153ac5b9 service neutron] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:55:39.298387 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 744/1493] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:57:07.458238 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f4fa-5b82-4d8a-a56e-7f68d8f4874b None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:57:07.458861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f4fa-5b82-4d8a-a56e-7f68d8f4874b None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:57:07.458861 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f4fa-5b82-4d8a-a56e-7f68d8f4874b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:57:07.477904 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-f366f4fa-5b82-4d8a-a56e-7f68d8f4874b None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:57:07.479070 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-f366f4fa-5b82-4d8a-a56e-7f68d8f4874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:57:07.488000 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 750/1494] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 3 09:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:57:07.495895 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73171b-2c4a-472a-a904-f812c42c3ad4 None None] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:57:07.496414 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73171b-2c4a-472a-a904-f812c42c3ad4 None None] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:57:07.496414 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73171b-2c4a-472a-a904-f812c42c3ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:57:07.516075 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.auth.core [None req-ea73171b-2c4a-472a-a904-f812c42c3ad4 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:57:07.517234 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-ea73171b-2c4a-472a-a904-f812c42c3ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:57:07.526503 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 745/1495] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 3 09:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:57:07.531059 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f4fa-5b82-4d8a-a56e-7f68d8f4874b None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:57:07.540591 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f4fa-5b82-4d8a-a56e-7f68d8f4874b None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:57:07.545472 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd65a97-d743-4d92-ad8c-42dffb7b4958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4434afe425d5493fb9f74ff63598d4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:57:07.546143 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd65a97-d743-4d92-ad8c-42dffb7b4958 admin admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:57:07.546417 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd65a97-d743-4d92-ad8c-42dffb7b4958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:57:07.546816 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd65a97-d743-4d92-ad8c-42dffb7b4958 admin admin] PATH_INFO: `/v3/domains` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:57:07.547540 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd65a97-d743-4d92-ad8c-42dffb7b4958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 09:57:07.547843 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd65a97-d743-4d92-ad8c-42dffb7b4958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:57:07.548856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: WARNING py.warnings [None req-5bd65a97-d743-4d92-ad8c-42dffb7b4958 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 09:57:07.548856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: warnings.warn(msg) May 03 09:57:07.548856 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: May 03 09:57:07.549745 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd65a97-d743-4d92-ad8c-42dffb7b4958 admin admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:57:07.561045 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 751/1496] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 3 09:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 09:57:07.569327 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73171b-2c4a-472a-a904-f812c42c3ad4 None None] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:57:07.579373 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73171b-2c4a-472a-a904-f812c42c3ad4 None None] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:57:07.585216 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aca4f6-40d2-4926-984a-96ffd16123ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4434afe425d5493fb9f74ff63598d4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:57:07.585895 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aca4f6-40d2-4926-984a-96ffd16123ce admin admin] REQUEST_METHOD: `POST` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:57:07.586169 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aca4f6-40d2-4926-984a-96ffd16123ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:57:07.586435 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aca4f6-40d2-4926-984a-96ffd16123ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:57:07.587124 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aca4f6-40d2-4926-984a-96ffd16123ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:57:07.588883 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: WARNING py.warnings [None req-c8aca4f6-40d2-4926-984a-96ffd16123ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 09:57:07.588883 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: warnings.warn(msg) May 03 09:57:07.588883 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: May 03 09:57:07.590101 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aca4f6-40d2-4926-984a-96ffd16123ce admin admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:57:07.631688 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 746/1497] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 3 09:57:07 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:57:07.636868 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd65a97-d743-4d92-ad8c-42dffb7b4958 admin admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:57:07.648108 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd65a97-d743-4d92-ad8c-42dffb7b4958 admin admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:57:07.701436 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0cf7d-fe2b-4c68-b1d9-7b745b8042c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4434afe425d5493fb9f74ff63598d4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:57:07.702146 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0cf7d-fe2b-4c68-b1d9-7b745b8042c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:57:07.702421 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0cf7d-fe2b-4c68-b1d9-7b745b8042c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:57:07.702683 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0cf7d-fe2b-4c68-b1d9-7b745b8042c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:57:07.703437 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0cf7d-fe2b-4c68-b1d9-7b745b8042c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:57:07.704559 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: WARNING py.warnings [None req-8dd0cf7d-fe2b-4c68-b1d9-7b745b8042c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 09:57:07.704559 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: warnings.warn(msg) May 03 09:57:07.704559 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: May 03 09:57:07.705747 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0cf7d-fe2b-4c68-b1d9-7b745b8042c5 admin admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:57:07.727629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 752/1498] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 3 09:57:07 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 09:57:07.731754 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aca4f6-40d2-4926-984a-96ffd16123ce admin admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:57:07.742677 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aca4f6-40d2-4926-984a-96ffd16123ce admin admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:57:07.748059 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c22e46-4adc-4cf1-a4e6-d9bf56c277cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4434afe425d5493fb9f74ff63598d4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:57:07.748742 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c22e46-4adc-4cf1-a4e6-d9bf56c277cc admin admin] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:57:07.749016 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c22e46-4adc-4cf1-a4e6-d9bf56c277cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:57:07.749282 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c22e46-4adc-4cf1-a4e6-d9bf56c277cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:57:07.750051 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c22e46-4adc-4cf1-a4e6-d9bf56c277cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:57:07.751065 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: WARNING py.warnings [None req-01c22e46-4adc-4cf1-a4e6-d9bf56c277cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 09:57:07.751065 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: warnings.warn(msg) May 03 09:57:07.751065 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: May 03 09:57:07.751970 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c22e46-4adc-4cf1-a4e6-d9bf56c277cc admin admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:57:07.765270 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 747/1499] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 3 09:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:57:07.770369 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0cf7d-fe2b-4c68-b1d9-7b745b8042c5 admin admin] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:57:07.781427 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0cf7d-fe2b-4c68-b1d9-7b745b8042c5 admin admin] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:57:07.788708 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bdae9-efc8-43c0-9e42-c51d64cf52c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4434afe425d5493fb9f74ff63598d4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:57:07.789619 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bdae9-efc8-43c0-9e42-c51d64cf52c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:57:07.790027 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bdae9-efc8-43c0-9e42-c51d64cf52c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:57:07.790383 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bdae9-efc8-43c0-9e42-c51d64cf52c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:57:07.791516 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bdae9-efc8-43c0-9e42-c51d64cf52c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:57:07.792870 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: WARNING py.warnings [None req-7e5bdae9-efc8-43c0-9e42-c51d64cf52c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 09:57:07.792870 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: warnings.warn(msg) May 03 09:57:07.792870 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: May 03 09:57:07.793778 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bdae9-efc8-43c0-9e42-c51d64cf52c8 admin admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:57:07.809448 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 753/1500] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 3 09:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 09:57:07.813949 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c22e46-4adc-4cf1-a4e6-d9bf56c277cc admin admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:57:07.824060 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c22e46-4adc-4cf1-a4e6-d9bf56c277cc admin admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:57:07.829471 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de5c46-d3bc-449d-8aaa-f65c76c26876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4434afe425d5493fb9f74ff63598d4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:57:07.830384 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de5c46-d3bc-449d-8aaa-f65c76c26876 admin admin] REQUEST_METHOD: `PUT` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:57:07.830656 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de5c46-d3bc-449d-8aaa-f65c76c26876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:57:07.830921 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de5c46-d3bc-449d-8aaa-f65c76c26876 admin admin] PATH_INFO: `/v3/projects/8e6901d76e804d9b83579c17c74b8bc7/users/6f113c51e4fc4f35a49cb5e5359e9457/roles/9e77c7f209fd4468bcf1b89bfef3c236` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:57:07.845921 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de5c46-d3bc-449d-8aaa-f65c76c26876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6901d76e804d9b83579c17c74b8bc7, user_id=6f113c51e4fc4f35a49cb5e5359e9457, role_id=9e77c7f209fd4468bcf1b89bfef3c236)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:57:07.846944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: WARNING py.warnings [None req-63de5c46-d3bc-449d-8aaa-f65c76c26876 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 09:57:07.846944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: warnings.warn(msg) May 03 09:57:07.846944 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: May 03 09:57:07.848874 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de5c46-d3bc-449d-8aaa-f65c76c26876 admin admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:57:07.864317 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 748/1501] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 3 09:57:07 2022] PUT /identity/v3/projects/8e6901d76e804d9b83579c17c74b8bc7/users/6f113c51e4fc4f35a49cb5e5359e9457/roles/9e77c7f209fd4468bcf1b89bfef3c236 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 09:57:07.875880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c682-06b2-4910-8449-4b414ec54b61 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:57:07.876204 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c682-06b2-4910-8449-4b414ec54b61 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:57:07.876474 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c682-06b2-4910-8449-4b414ec54b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:57:07.905131 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-19d0c682-06b2-4910-8449-4b414ec54b61 None None] MFA Rules not processed for user `6f113c51e4fc4f35a49cb5e5359e9457`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:57:07.906421 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-19d0c682-06b2-4910-8449-4b414ec54b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:57:07.975274 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 754/1502] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 3 09:57:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 09:57:07.986804 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de5c46-d3bc-449d-8aaa-f65c76c26876 admin admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:57:08.059550 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de5c46-d3bc-449d-8aaa-f65c76c26876 admin admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:57:08.066372 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4318953-5875-429a-a368-92f180b8d1f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb008cfc6424998917da60d72689f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:57:08.067008 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4318953-5875-429a-a368-92f180b8d1f5 service nova] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:57:08.067280 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4318953-5875-429a-a368-92f180b8d1f5 service nova] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:57:08.067546 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4318953-5875-429a-a368-92f180b8d1f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:57:08.075505 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4318953-5875-429a-a368-92f180b8d1f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:57:08.077099 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4318953-5875-429a-a368-92f180b8d1f5 service nova] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:57:08.086217 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 749/1503] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:57:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:57:08.160880 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca590c5-60a8-4f51-8dc8-5cd70ae65159 None None] REQUEST_METHOD: `GET` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:57:08.161175 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca590c5-60a8-4f51-8dc8-5cd70ae65159 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:57:08.161449 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca590c5-60a8-4f51-8dc8-5cd70ae65159 None None] PATH_INFO: `/` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:57:08.162809 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 755/1504] 10.222.0.55 () {52 vars in 829 bytes} [Tue May 3 09:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 09:57:08.166621 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4318953-5875-429a-a368-92f180b8d1f5 service nova] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:57:08.230574 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4318953-5875-429a-a368-92f180b8d1f5 service nova] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:57:08.235810 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb310a-1ea7-4c47-8688-0e501dc64d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4434afe425d5493fb9f74ff63598d4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:57:08.236681 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb310a-1ea7-4c47-8688-0e501dc64d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:57:08.236954 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb310a-1ea7-4c47-8688-0e501dc64d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:57:08.237223 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb310a-1ea7-4c47-8688-0e501dc64d29 admin admin] PATH_INFO: `/v3/users/6f113c51e4fc4f35a49cb5e5359e9457` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:57:08.238440 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb310a-1ea7-4c47-8688-0e501dc64d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f113c51e4fc4f35a49cb5e5359e9457)` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:57:08.239541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: WARNING py.warnings [None req-9dbb310a-1ea7-4c47-8688-0e501dc64d29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 09:57:08.239541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: warnings.warn(msg) May 03 09:57:08.239541 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: May 03 09:57:08.240737 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb310a-1ea7-4c47-8688-0e501dc64d29 admin admin] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:57:08.311467 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [None req-9dbb310a-1ea7-4c47-8688-0e501dc64d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f113c51e4fc4f35a49cb5e5359e9457'} {{(pid=79789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:57:08.323197 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [None req-9dbb310a-1ea7-4c47-8688-0e501dc64d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f113c51e4fc4f35a49cb5e5359e9457'} {{(pid=79789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:57:08.324025 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [None req-9dbb310a-1ea7-4c47-8688-0e501dc64d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f113c51e4fc4f35a49cb5e5359e9457'} {{(pid=79789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:57:08.343780 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [None req-9dbb310a-1ea7-4c47-8688-0e501dc64d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f113c51e4fc4f35a49cb5e5359e9457'} {{(pid=79789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:57:08.358561 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.notifications [None req-9dbb310a-1ea7-4c47-8688-0e501dc64d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f113c51e4fc4f35a49cb5e5359e9457'} {{(pid=79789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:57:08.364748 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 750/1505] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 3 09:57:08 2022] DELETE /identity/v3/users/6f113c51e4fc4f35a49cb5e5359e9457 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 09:57:08.369312 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb95432-0f48-4cb1-bdf8-b9ad3ede7b07 None None] REQUEST_METHOD: `POST` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:57:08.369629 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb95432-0f48-4cb1-bdf8-b9ad3ede7b07 None None] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:57:08.369950 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb95432-0f48-4cb1-bdf8-b9ad3ede7b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:57:08.388268 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.auth.core [None req-eeb95432-0f48-4cb1-bdf8-b9ad3ede7b07 None None] MFA Rules not processed for user `3409da654b054b979d2c52a756bb7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 09:57:08.389537 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-eeb95432-0f48-4cb1-bdf8-b9ad3ede7b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:57:08.455530 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 756/1506] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 3 09:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 09:57:08.465250 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb310a-1ea7-4c47-8688-0e501dc64d29 admin admin] Authenticating user token {{(pid=79789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:57:08.466880 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.fernet_utils [None req-9dbb310a-1ea7-4c47-8688-0e501dc64d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:57:08.525463 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb310a-1ea7-4c47-8688-0e501dc64d29 admin admin] Validating token access rules against request {{(pid=79789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:57:08.529768 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e3047-985d-4504-b441-6c3ea8af9abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb3d5bb36f445cabb62cacf1b34984d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f395f4842c39422d962dbddc4cf2897a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:57:08.530453 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e3047-985d-4504-b441-6c3ea8af9abe service neutron] REQUEST_METHOD: `GET` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:57:08.530719 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e3047-985d-4504-b441-6c3ea8af9abe service neutron] SCRIPT_NAME: `/identity` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:57:08.531010 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e3047-985d-4504-b441-6c3ea8af9abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:57:08.540929 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e3047-985d-4504-b441-6c3ea8af9abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:57:08.542649 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e3047-985d-4504-b441-6c3ea8af9abe service neutron] RBAC: Authorization granted {{(pid=79789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:57:08.552394 dv-cinder-796806-3-iscsi devstack@keystone.service[79789]: [pid: 79789|app: 0|req: 751/1507] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 3 09:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 09:57:08.932585 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb95432-0f48-4cb1-bdf8-b9ad3ede7b07 None None] Authenticating user token {{(pid=79790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 09:57:08.935113 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.fernet_utils [None req-eeb95432-0f48-4cb1-bdf8-b9ad3ede7b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 09:57:08.947818 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb95432-0f48-4cb1-bdf8-b9ad3ede7b07 None None] Validating token access rules against request {{(pid=79790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 09:57:08.952955 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdafadd-cd74-4c14-b016-75d0443899df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409da654b054b979d2c52a756bb7ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4434afe425d5493fb9f74ff63598d4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 09:57:08.954126 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdafadd-cd74-4c14-b016-75d0443899df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 09:57:08.954413 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdafadd-cd74-4c14-b016-75d0443899df admin admin] SCRIPT_NAME: `/identity` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 09:57:08.954686 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdafadd-cd74-4c14-b016-75d0443899df admin admin] PATH_INFO: `/v3/projects/8e6901d76e804d9b83579c17c74b8bc7` {{(pid=79790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 09:57:08.956018 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdafadd-cd74-4c14-b016-75d0443899df admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6901d76e804d9b83579c17c74b8bc7)` {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 09:57:08.957038 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: WARNING py.warnings [None req-1fdafadd-cd74-4c14-b016-75d0443899df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 09:57:08.957038 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: warnings.warn(msg) May 03 09:57:08.957038 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: May 03 09:57:08.958263 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdafadd-cd74-4c14-b016-75d0443899df admin admin] RBAC: Authorization granted {{(pid=79790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 09:57:09.019203 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [None req-1fdafadd-cd74-4c14-b016-75d0443899df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6901d76e804d9b83579c17c74b8bc7', 'request_id': 'req-1fdafadd-cd74-4c14-b016-75d0443899df'} {{(pid=79790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:57:09.032353 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [None req-1fdafadd-cd74-4c14-b016-75d0443899df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6901d76e804d9b83579c17c74b8bc7', 'request_id': 'req-1fdafadd-cd74-4c14-b016-75d0443899df'} {{(pid=79790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:57:09.038530 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [None req-1fdafadd-cd74-4c14-b016-75d0443899df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6901d76e804d9b83579c17c74b8bc7', 'request_id': 'req-1fdafadd-cd74-4c14-b016-75d0443899df'} {{(pid=79790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:57:09.053608 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [None req-1fdafadd-cd74-4c14-b016-75d0443899df admin admin] The token cache is being invalidate because project 8e6901d76e804d9b83579c17c74b8bc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 09:57:09.054039 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [None req-1fdafadd-cd74-4c14-b016-75d0443899df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:57:09.054799 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: DEBUG keystone.notifications [None req-1fdafadd-cd74-4c14-b016-75d0443899df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 09:57:09.056407 dv-cinder-796806-3-iscsi devstack@keystone.service[79790]: [pid: 79790|app: 0|req: 757/1508] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 3 09:57:08 2022] DELETE /identity/v3/projects/8e6901d76e804d9b83579c17c74b8bc7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0)